Human Generated Data

Title

Untitled (women in kitchen, Chamberlain, South Dakota)
Date

1948, printed later
People

Artist: Orrion Barger, American active 1913 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.935

Human Generated Data

Title

Untitled (women in kitchen, Chamberlain, South Dakota)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1948, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.6
Person 99.5
Person 99
Person 98.9
Clothing 94.3
Apparel 94.3
Meal 89.2
Food 89.2
Room 86.2
Indoors 86.2
People 78.1
Home Decor 72.7
Dish 70.3
Linen 69.3
Chair 65.5
Furniture 65.5
Female 61.3
Appliance 59.9
Oven 57.9
Kitchen 56

Imagga
created on 2022-01-23

person 35.4
shop 35.3
people 34.6
man 30.9
adult 30.9
home 27.1
patient 25.5
male 24.2
room 24.1
salon 23.1
mercantile establishment 22.9
barbershop 22.7
happy 22.6
clinic 22.1
smiling 19.5
kitchen 19
women 19
nurse 18.8
interior 18.6
couple 18.3
hospital 17.8
professional 17.4
indoor 16.4
indoors 15.8
business 15.8
place of business 15.2
smile 15
modern 14.7
men 14.6
lifestyle 14.5
portrait 14.2
family 13.3
happiness 13.3
case 13.1
bakery 12.8
medical 12.4
together 12.3
clothing 12.2
sick person 12.2
table 12.1
two 11.9
health 11.8
work 11.8
life 11.7
teacher 11.6
businessman 11.5
husband 11.4
standing 11.3
house 10.9
care 10.7
office 10.6
cheerful 10.6
looking 10.4
style 10.4
doctor 10.3
corporate 10.3
senior 10.3
food 10.3
love 10.3
chair 9.8
wife 9.5
meeting 9.4
mature 9.3
mother 9.2
20s 9.2
businesswoman 9.1
fashion 9
dress 9
team 9
lady 8.9
group 8.9
cooking 8.7
clothes 8.4
attractive 8.4
inside 8.3
girls 8.2
worker 7.9
boy 7.8
sitting 7.7
expression 7.7
illness 7.6
casual 7.6
retail 7.6
dinner 7.6
establishment 7.6
adults 7.6
store 7.6
domestic 7.4
window 7.3
new 7.3
to 7.1
medicine 7

Google
created on 2022-01-23

Photograph 94.2
Cabinetry 86.5
Black-and-white 82.8
Countertop 82.8
Gas stove 79.9
Table 75.6
Kitchen appliance 75.4
Snapshot 74.3
Cooking 73.6
Cooktop 73.6
Vintage clothing 73
Event 72.5
Monochrome photography 70.9
Kitchen stove 70.6
Kitchen 69.8
Homemaker 68.9
Monochrome 68.1
Room 66.8
Art 66.6
Stock photography 64.7

Microsoft
created on 2022-01-23

person 98.2
wall 97.1
clothing 96.8
woman 95
kitchen 94
indoor 93.3
smile 89.1
dress 88.2
text 81.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-70
Gender Female, 100%
Happy 42.4%
Angry 23.4%
Calm 14.7%
Surprised 11.1%
Sad 3.6%
Disgusted 2.2%
Fear 1.6%
Confused 1%

AWS Rekognition

Age 59-69
Gender Female, 100%
Happy 53.4%
Calm 20.3%
Surprised 8.3%
Confused 7.2%
Disgusted 5.3%
Fear 1.9%
Sad 1.9%
Angry 1.6%

AWS Rekognition

Age 34-42
Gender Female, 99.9%
Calm 84%
Happy 9.8%
Surprised 2%
Confused 1.2%
Sad 1%
Angry 0.8%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 57-65
Gender Female, 100%
Calm 76.1%
Disgusted 7.5%
Confused 5.1%
Angry 3.6%
Surprised 3.5%
Fear 2.1%
Sad 1.1%
Happy 0.9%

AWS Rekognition

Age 70-80
Gender Female, 100%
Calm 99.3%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Angry 0%
Happy 0%
Sad 0%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 56
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 65.5%

Captions

Microsoft

Eva Mae LeFevre et al. standing in a kitchen 90.5%
Eva Mae LeFevre et al. standing in a kitchen 82.2%
Eva Mae LeFevre et al. standing in the kitchen 82.1%

Text analysis

Amazon

86%
80
P11