Human Generated Data

Title

Untitled (family gathering at dinner table)

Date

1936

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1492

Human Generated Data

Title

Untitled (family gathering at dinner table)

People

Artist: Durette Studio, American 20th century

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.5
Human 99.5
Person 99.5
Person 99.5
Person 99.2
Person 99.1
Person 98.7
Person 98.4
Person 98.1
Furniture 98.1
Person 98
Food 97.7
Meal 97.7
Table 95.4
Accessory 93.8
Tie 93.8
Accessories 93.8
Tablecloth 93.1
Dish 92.6
Person 87
People 86.7
Dining Table 82.4
Porcelain 77.6
Art 77.6
Pottery 77.6
Home Decor 73.5
Linen 71.5
Clothing 69.5
Apparel 69.5
Portrait 68.9
Photo 68.9
Photography 68.9
Face 68.9
Drawing 63.8
Dating 62.2
Helmet 61.3
Restaurant 60.7
Suit 59.1
Overcoat 59.1
Coat 59.1
Sitting 58.3
Chair 57.5
Senior Citizen 57.2
Female 56.8

Clarifai
created on 2019-06-01

group together 99.7
group 99.6
people 99.6
man 98.2
adult 97.7
leader 95.1
meeting 94.9
woman 92.2
actor 84.5
four 83.1
five 81.9
several 76.9
three 76.7
administration 76.4
education 73.9
partnership 73.1
portrait 72.9
facial expression 72.2
league 72.2
many 69.9

Imagga
created on 2019-06-01

man 39
people 37.4
male 36.2
person 35.8
adult 32.4
businessman 30.9
indoors 29.9
business 29.8
together 28.9
happy 28.8
table 26.9
smiling 26.8
sitting 26.6
men 26.6
colleagues 26.2
couple 25.3
office 25
meeting 24.5
team 24.2
businesspeople 22.8
businesswoman 21.8
women 21.4
cheerful 20.3
home 19.9
professional 19.6
mature 19.5
day 18.8
teamwork 18.5
talking 18.1
working 17.7
worker 17.7
30s 17.3
room 17.3
group 16.9
employee 16.6
senior 15.9
drink 15.9
work 15.8
camera 15.7
20s 15.6
waiter 15
executive 14.9
casual clothing 14.7
60s 14.7
40s 14.6
corporate 14.6
lifestyle 14.5
casual 14.4
enjoying 14.2
lab coat 14.2
desk 14.2
restaurant 14.1
friends 14.1
wine 14
middle aged 13.6
smile 12.8
associates 12.8
coworkers 12.8
horizontal 12.6
nurse 12.5
portrait 12.3
coat 12.2
friendship 12.2
looking 12
discussing 11.8
discussion 11.7
mid adult 11.6
clothing 11.6
job 11.5
face 11.4
doctor 11.3
color 11.1
clinic 11
indoor 11
meal 10.9
four people 10.9
sixties 10.8
four 10.6
kin 10.5
drinking 10.5
patient 10.5
laptop 10
confident 10
leisure 10
suit 9.9
senior adult 9.9
forties 9.8
older 9.7
medical 9.7
dining-room attendant 9.7
cooperation 9.7
adults 9.5
happiness 9.4
alcohol 9.4
food 9.3
hospital 9.1
health 9
socializing 8.9
entertaining 8.9
business people 8.9
collaboration 8.9
50s 8.8
having 8.7
daytime 8.7
elderly 8.6
females 8.5
specialist 8.5
modern 8.4
eating 8.4
inside 8.3
holding 8.3
successful 8.2
handsome 8
computer 8
lunch 8
dinner 8
boardroom 7.9
gathering 7.9
couples 7.8
businessmen 7.8
thirties 7.8
two people 7.8
busy 7.7
looking camera 7.7
attractive 7.7
twenties 7.7
manager 7.5
coffee 7.4
care 7.4
mother 7.3
teacher 7.3
child 7.1
medicine 7
glass 7

Google
created on 2019-06-01

Photograph 96.3
Event 73.3
Table 69.7
Stock photography 59.4
Family 57.7
Black-and-white 56.4
Team 52.3

Microsoft
created on 2019-06-01

person 96
clothing 92.1
table 91.6
old 88.2
text 87.6
woman 87.5
human face 87.1
posing 82.1
man 81.9
food 80.8
smile 78.6
group 75.3
tableware 70

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 93.2%
Disgusted 1.5%
Angry 2.3%
Confused 2.9%
Sad 4.9%
Happy 72.9%
Calm 9.5%
Surprised 6.1%

AWS Rekognition

Age 60-90
Gender Male, 64.1%
Confused 6%
Angry 3.9%
Sad 24.6%
Calm 41.1%
Disgusted 3.7%
Happy 15.1%
Surprised 5.5%

AWS Rekognition

Age 35-52
Gender Male, 95.1%
Sad 38%
Happy 27.8%
Surprised 4.6%
Calm 12.2%
Disgusted 9.9%
Confused 2.1%
Angry 5.3%

AWS Rekognition

Age 19-36
Gender Male, 99.3%
Disgusted 2%
Sad 7%
Happy 24.7%
Surprised 4.6%
Angry 3.9%
Calm 52%
Confused 5.7%

AWS Rekognition

Age 20-38
Gender Male, 98.2%
Disgusted 4.2%
Confused 11.3%
Surprised 8.6%
Calm 49.7%
Happy 9.5%
Angry 8.3%
Sad 8.5%

AWS Rekognition

Age 26-43
Gender Male, 87.4%
Angry 3.3%
Surprised 10.1%
Disgusted 3.4%
Sad 17.9%
Calm 3.8%
Happy 23.2%
Confused 38.2%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Confused 45.3%
Happy 52.7%
Surprised 45.4%
Angry 45.4%
Disgusted 45.1%
Calm 45.7%
Sad 45.3%

AWS Rekognition

Age 23-38
Gender Male, 88.8%
Surprised 5.9%
Disgusted 4%
Calm 13.8%
Happy 48.3%
Sad 19.9%
Angry 4.3%
Confused 3.8%

AWS Rekognition

Age 26-43
Gender Female, 51%
Calm 46.5%
Surprised 45.9%
Sad 46.3%
Confused 45.9%
Disgusted 45.4%
Happy 49.3%
Angry 45.7%

Feature analysis

Amazon

Person 99.5%
Tie 93.8%
Dining Table 82.4%
Helmet 61.3%

Captions

Microsoft

a group of people posing for a photo 92.2%
an old photo of a group of people posing for the camera 90%
an old photo of a group of people posing for a picture 89.9%