Human Generated Data

Title

Untitled (man and woman drinking coffee at breakfast table)
Date

1961
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15386

Human Generated Data

Title

Untitled (man and woman drinking coffee at breakfast table)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.7
Human 99.7
Person 99.4
Plant 90.8
Food 81.7
Furniture 74.8
Fruit 73.3
Meal 70.2
Clothing 65.9
Apparel 65.9
Table 64.1
Produce 62
Wood 59.6
Home Decor 58.9
Dining Table 56.8
Cafeteria 56.4
Restaurant 56.4
Dish 55.3
Buffet 55.3

Imagga
created on 2022-03-05

home 38.3
people 36.9
smiling 33.3
indoors 32.5
happy 32
person 30.1
sitting 28.4
table 27.7
child 26.4
mother 26.2
adult 25.7
happiness 25.1
women 24.5
mature 22.3
family 22.3
senior 20.6
cheerful 20.3
lifestyle 20.3
together 20.2
attractive 18.2
man 17.5
fun 17.2
male 17.2
two 17
grandma 16.8
parent 16.7
couple 16.6
smile 16.4
blond 16.3
friends 16
drink 15.9
daughter 15.7
holding 15.7
kitchen 15.2
relaxing 14.6
drinking 14.4
portrait 14.3
interior 14.2
pretty 14
girls 13.7
childhood 13.5
love 13.4
room 13.3
group 12.9
domestic 12.6
wife 12.3
food 12.2
coffee 12.1
inside 12
casual 11.9
cup 11.6
husband 11.5
enjoying 11.4
glasses 11.1
indoor 11
sofa 10.6
elderly 10.5
adults 10.4
laughing 10.4
togetherness 10.4
kids 10.4
eating 10.1
20s 10.1
children 10
kid 9.8
retired 9.7
boy 9.6
hair 9.5
men 9.5
learning 9.4
friendship 9.4
cute 9.3
son 9.3
meal 9.3
father 9.3
grandfather 9.2
dinner 9.1
alcohol 8.9
wine 8.8
grandmother 8.8
education 8.7
chair 8.5
joy 8.4
color 8.4
clothing 8.3
dress 8.1
shop 8.1
looking 8
little 8
face 7.8
middle aged 7.8
couch 7.7
females 7.6
salon 7.6
meeting 7.5
house 7.5
enjoyment 7.5
care 7.4
joyful 7.4
book 7.3
playing 7.3
glass 7.2

Google
created on 2022-03-05

Tableware 94.3
Photograph 94.1
Table 93.7
Food 93.5
Plate 86
Happy 83.3
Sharing 83
Cuisine 77.7
Drink 74.8
Snapshot 74.3
Dish 73.6
Cooking 73.5
Natural foods 71.7
Event 69.4
Grapefruit 68.9
Drinkware 68.5
Junk food 67
Juice 67
Citrus 66
Comfort food 65.3

Microsoft
created on 2022-03-05

food 99.1
person 98.5
fast food 95.6
indoor 93.5
clothing 81.7
human face 73.4
snack 67.5
dinner 67.5
baked goods 57.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Female, 100%
Happy 99.4%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Sad 0%
Calm 0%

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Dining Table 56.8%

Captions

Microsoft

a woman sitting at a table with food 90.8%
a woman sitting at a table eating food 73%
a woman sitting at a table with some food 72.9%