Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the treatment
Date

c. 1905
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.334.4

Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the treatment

People

Artist: Unidentified Artist,

Date

c. 1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.3
Human 99.3
Person 99.1
Shoe 92.3
Footwear 92.3
Clothing 92.3
Apparel 92.3
Bed 90.1
Furniture 90.1
Porch 88.8
Clinic 82.7
Hospital 77.5
Shoe 71.9
Deck 55.6
Funeral 55.1

Imagga
created on 2022-06-25

deck 63.1
interior 47.8
room 41.7
chair 35.3
house 30.4
furniture 30
table 29.5
home 28.7
modern 28
floor 25.1
indoors 22.8
window 22.2
architecture 22
sofa 20.2
lamp 20
decor 18.6
luxury 18
design 18
inside 17.5
comfortable 17.2
living 16.1
seat 16.1
office 16
bed 14.4
hotel 14.3
relaxation 14.2
light 14
bedroom 13.7
building 13.6
travel 13.4
business 13.4
wood 13.3
glass 13.2
relax 12.6
apartment 12.5
hall 12.4
lifestyle 12.3
residential 11.5
man 11.4
urban 11.4
empty 11.2
people 11.2
hospital 11.1
work 11
indoor 11
nobody 10.9
city 10.8
color 10.6
structure 10.5
estate 10.5
sitting 10.3
comfort 9.6
style 9.6
enjoyment 9.4
3d 9.3
rest 9
hardwood 8.8
chairs 8.8
two people 8.8
women 8.7
couch 8.7
decoration 8.7
leather 8.5
real 8.5
desk 8.5
elegance 8.4
reflection 8.2
pillow 7.9
furnishings 7.9
20 24 years 7.9
living room 7.8
casual clothing 7.8
carpet 7.8
full length 7.8
lighting 7.7
men 7.7
passenger 7.7
communication 7.6
contemporary 7.5
place 7.5
vacation 7.4
smiling 7.2
residence 7.2
family 7.1
dwelling 7.1
day 7.1
happiness 7.1
fireplace 7

Google
created on 2022-06-25

Building 89.8
Dress 86.6
Window 85.5
Style 83.9
Black-and-white 83.4
Wedding dress 77.8
Monochrome 76.4
Door 73.9
Vintage clothing 73.7
Monochrome photography 73.6
House 72.6
Classic 72.5
Room 68.9
Event 68
Stock photography 63.1
Home 62.8
Bride 61.7
Bridal clothing 61.5
Hardwood 61.5
Sky 58.8

Microsoft
created on 2022-06-25

indoor 87.4
person 78.8
clothing 76.2
furniture 66.8
white 66.5
man 63.4
house 51.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 50.3%
Calm 72.7%
Sad 33.5%
Surprised 6.5%
Fear 6%
Confused 1.9%
Disgusted 1.4%
Angry 1.1%
Happy 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.4%
Sad 99.8%
Calm 24.3%
Surprised 6.5%
Fear 6.1%
Disgusted 1.1%
Confused 1%
Angry 0.7%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 92.3%
Bed 90.1%

Captions

Microsoft

a person sitting on a bed 74.4%
a man and a woman sitting on a bed 55.8%
a person sitting on a bed 55.7%