Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Ohio. Dayton. National Cash Register Company: Welfare Institutions of the National Cash Register Company, Dayton, Ohio.: Advantages for Employes: First Aid to the Injured
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.326.A.4

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Ohio. Dayton. National Cash Register Company: Welfare Institutions of the National Cash Register Company, Dayton, Ohio.: Advantages for Employes: First Aid to the Injured

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.8
Human 99.8
Person 99.1
Chair 99
Furniture 99
Person 95.4
Bed 94
Housing 83.7
Building 83.7
Dining Table 75.4
Table 75.4
Restaurant 64.5
Clinic 58.9

Imagga
created on 2022-06-25

home 37.5
furniture 35
room 32.5
couple 27.9
adult 27.4
indoors 26.4
love 26
bed 25.8
people 25.7
interior 25.6
man 24.2
happy 23.8
hospital 22.9
happiness 22.7
baby bed 21.9
smiling 21.7
bedroom 20.9
chair 20.7
person 20.5
family 19.6
comfortable 19.1
sitting 18.9
male 18.5
child 17.6
couch 17.4
lifestyle 17.3
smile 17.1
furnishing 16.4
cheerful 16.3
house 15.9
sofa 15.6
women 15
cradle 14.7
indoor 14.6
seat 14.4
armchair 14.4
loving 14.3
relaxing 13.6
portrait 13.6
together 13.1
mother 12.8
fun 12.7
pretty 12.6
attractive 12.6
husband 12.4
relationship 12.2
dress 11.7
kid 11.5
two 11
holiday 10.7
holding 10.7
care 10.7
comfort 10.6
wife 10.4
togetherness 10.4
pillow 10.4
life 10.3
20s 10.1
relaxation 10
children 10
20 24 years 9.8
lady 9.7
bride 9.6
men 9.4
face 9.2
wedding 9.2
window 9.2
leisure 9.1
groom 9.1
father 9
fashion 9
daughter 9
domestic 8.9
four-poster 8.9
sexy 8.8
hug 8.7
living 8.5
adults 8.5
casual 8.5
enjoyment 8.4
cushion 8.4
playing 8.2
cup 8.1
childhood 8.1
romantic 8
celebration 8
chairs 7.8
crib 7.8
lover 7.8
color 7.8
two people 7.8
married 7.7
apartment 7.7
break 7.6
females 7.6
human 7.5
one 7.5
inside 7.4
grandma 7.4
joyful 7.3
light 7.3
rocking chair 7.3
new 7.3
bright 7.1

Google
created on 2022-06-25

Furniture 94.5
Standing 86.4
Table 84.6
Style 83.8
Black-and-white 82.6
Hat 74.6
Comfort 73.9
Monochrome photography 73.4
Vintage clothing 73.3
Chair 71.4
Monochrome 71.3
Classic 69.6
Room 67.8
Event 67.6
Sitting 66.7
Suit 61.4
Door 60.1
Service 54.8
Linens 53.5
Bench 53.2

Microsoft
created on 2022-06-25

indoor 99.2
furniture 99.1
floor 99.1
table 98.7
chair 97
wall 95.4
clothing 95.3
person 91.9
bed 85.6
room 81.5
man 60.9
bedroom 37.1
dining room 10.1

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 94%
Calm 75.1%
Sad 12%
Surprised 7.3%
Fear 6.1%
Happy 5%
Angry 1.8%
Confused 1.8%
Disgusted 1.2%

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 73.9%
Sad 33.7%
Surprised 6.7%
Fear 6%
Confused 1.4%
Disgusted 0.8%
Angry 0.6%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Male, 100%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 1.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 99%
Bed 94%
Dining Table 75.4%

Captions

Microsoft

a person sitting on a bed in a room 89.1%
a person sitting on a bed 82.9%
a person sitting at a table in a room 82.8%