Human Generated Data

Title

Untitled (men standing around couple, seated, with fiftieth anniversary cake)
Date

1937
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4158

Human Generated Data

Title

Untitled (men standing around couple, seated, with fiftieth anniversary cake)

People

Artist: Durette Studio, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.3
Human 99.3
Person 99.3
Person 99.2
Person 99.1
Person 98.6
Person 98.4
Person 98.3
Tie 95.5
Accessory 95.5
Accessories 95.5
Sunglasses 83.1
Tie 80.3
Helmet 67.9
Clothing 67.9
Apparel 67.9
Chef 59.6

Clarifai
created on 2019-06-01

people 99.7
group 99
adult 98.2
group together 97.3
leader 97.2
man 95.3
administration 94.7
medical practitioner 94.2
several 93.9
scientist 92.5
woman 91.1
facial expression 91.1
wear 91
five 90.9
four 89.5
many 89.2
portrait 85.3
three 84.8
outfit 76.7
veil 73.1

Imagga
created on 2019-06-01

coat 100
lab coat 100
garment 60.8
man 49.8
male 47.6
doctor 41.4
clothing 36.7
people 35.7
adult 34.5
person 33.9
medical 33.6
team 32.3
professional 32
businessman 31.8
business 31.6
hospital 31
happy 30.1
clinic 29.3
job 27.4
office 27.3
colleagues 27.2
medicine 25.6
smiling 25.3
mature 25.1
men 24.9
health 23.6
care 23.1
work 22.8
worker 22.2
working 22.1
indoors 22
teamwork 21.3
occupation 21.1
businesspeople 20.9
businesswoman 20
looking 20
meeting 19.8
senior 19.7
doctors 19.7
nurse 19.4
group 19.4
stethoscope 19.3
30s 19.3
clinical 18.6
indoor 18.3
portrait 18.1
corporate 18.1
40s 17.5
together 17.5
confident 17.3
practitioner 17.3
elderly 17.2
uniform 17.1
casual 17
associates 16.7
table 16.5
desk 16.1
lifestyle 15.9
coworkers 15.7
smile 15.7
20s 15.6
sitting 15.5
cheerful 15.5
handsome 15.2
women 15
couple 14.8
mid adult 14.5
specialist 14.2
standing 13.9
successful 13.7
patient 13.7
suit 13.5
bright 12.9
color 12.8
face 12.8
day 12.6
happiness 12.5
talking 12.4
surgeon 11.9
two 11.9
laptop 11.9
discussing 11.8
expertise 11.7
four 11.5
ethnic 11.4
treatment 11
general practitioner 10.9
healing 10.8
50s 10.8
consultant 10.7
cooperation 10.6
laboratory 10.6
attractive 10.5
illness 10.5
friendly 10.1
room 10
clinician 9.9
business people 9.9
fifties 9.8
crew 9.8
30 35 years 9.8
modern 9.8
heal 9.8
forties 9.8
businessmen 9.8
middle aged 9.7
success 9.7
busy 9.6
home 9.6
profession 9.6
staff 9.6
executive 9.5
camera 9.3
horizontal 9.2
old 9.1
technology 8.9
expert 8.9
good mood 8.8
discussion 8.8
look 8.8
assistant 8.8
older 8.7
partnership 8.7
twenties 8.6
manager 8.4
human 8.3
employee 8.1
computer 8
building 7.9
collaboration 7.9
diagnosis 7.8
25 30 years 7.8
60s 7.8
thirties 7.8
examination 7.8
pharmacist 7.8
2 7.8
practice 7.7
partner 7.7
adults 7.6
career 7.6
company 7.4
light 7.4
student 7.4

Google
created on 2019-06-01

Photograph 97.1
Snapshot 83.3
Stock photography 67.6
Event 62.7
Family 56.9

Microsoft
created on 2019-06-01

posing 99.8
person 99.8
outdoor 93.7
standing 93.1
group 89.4
clothing 78.7
wedding dress 73.9
funeral 72.5
old 70.2
man 64.3
bride 56.5
male 15.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 99.7%
Confused 4.3%
Happy 3.3%
Calm 77%
Disgusted 0.9%
Sad 9.9%
Angry 2.5%
Surprised 2.2%

AWS Rekognition

Age 23-38
Gender Male, 95.5%
Happy 2%
Confused 0.9%
Disgusted 0.4%
Sad 4.5%
Calm 89.8%
Angry 1.6%
Surprised 0.8%

AWS Rekognition

Age 20-38
Gender Male, 98.8%
Disgusted 0.7%
Confused 1%
Surprised 3.2%
Calm 79.2%
Happy 7.9%
Angry 4.6%
Sad 3.4%

AWS Rekognition

Age 26-43
Gender Male, 96.1%
Happy 1.6%
Disgusted 0.7%
Angry 1.5%
Calm 87.3%
Sad 6.3%
Confused 1.3%
Surprised 1.4%

AWS Rekognition

Age 20-38
Gender Female, 64.1%
Disgusted 0.9%
Confused 2.9%
Sad 5.8%
Happy 7.7%
Angry 13.3%
Surprised 4.3%
Calm 65%

AWS Rekognition

Age 26-43
Gender Male, 81%
Surprised 3.7%
Disgusted 1.1%
Calm 69.4%
Happy 18.9%
Sad 4%
Angry 1.4%
Confused 1.5%

AWS Rekognition

Age 26-43
Gender Male, 99%
Sad 3.6%
Surprised 2%
Happy 2%
Angry 2.1%
Calm 86.1%
Confused 3.4%
Disgusted 0.7%

Feature analysis

Amazon

Person 99.3%
Tie 95.5%
Sunglasses 83.1%
Helmet 67.9%

Captions

Microsoft

a group of people posing for a photo 98.6%
a group of people posing for the camera 98.5%
a group of people posing for a picture 98.4%