Human Generated Data

Title

Untitled (studio portrait of thirteen member family)

Date

c. 1953

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11142

Human Generated Data

Title

Untitled (studio portrait of thirteen member family)

People

Artist: Claseman Studio, American 20th century

Date

c. 1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Tie 99.9
Accessories 99.9
Accessory 99.9
Human 99.5
Person 99.5
Person 99.4
Person 99.3
Person 99.2
Person 99
Person 98.5
Tie 98.4
Person 98.1
Tie 97.9
Person 97.8
Tie 97.7
Person 96.2
Head 96.2
Person 95.6
Clothing 95.5
Apparel 95.5
Person 95
Person 94.5
Person 93.4
Face 93
Tie 90.8
Coat 83.5
Overcoat 83.5
Suit 83.5
Shirt 83.4
Crowd 83.1
Tie 80.1
Suit 78.7
People 74.9
Sunglasses 74.2
Tie 71.4
Lab Coat 67.9
Sunglasses 66.3
Suit 62.9
Necktie 61
Huddle 60.9
Suit 60.6
Crystal 60.2
Scientist 56.8
Smile 55.8
Jaw 55.6
Sailor Suit 55.4

Clarifai
created on 2019-03-26

people 99.2
man 98.9
adult 97.8
group 97.2
group together 96
teamwork 93.7
cooperation 91.2
woman 90.7
partnership 90.5
business 89.7
indoors 89.4
education 88.8
portrait 87.7
facial expression 84.5
many 83.5
leader 82.9
uniform 81.7
unity 80.7
horizontal 79.7
togetherness 79.5

Imagga
created on 2019-03-26

coat 100
lab coat 100
doctor 56.4
man 51.8
medical 49.5
specialist 49.3
garment 47.3
hospital 47
male 44
nurse 42.6
professional 42.1
medicine 37
adult 35.9
person 34.8
practitioner 34.6
clinic 33.6
occupation 33
stethoscope 32.7
health 32.7
job 31.9
people 31.8
team 31.4
care 31.3
uniform 29.5
smiling 29
mature 28.8
clothing 28.7
happy 28.2
business 27.4
doctors 26.6
businessman 25.6
work 24.3
colleagues 24.3
looking 24
portrait 24
worker 23.2
handsome 23.2
working 22.1
confident 21.9
men 21.5
30s 21.2
patient 21
clinical 20.5
group 20.2
profession 20.1
smile 20
office 19.3
staff 17.2
surgeon 17
teamwork 16.7
40s 16.6
indoor 16.4
elderly 16.3
illness 16.2
indoors 15.8
laboratory 15.4
standing 14.8
cheerful 14.6
consultant 14.6
expertise 14.6
senior 14.1
mid adult 13.5
happiness 13.3
camera 13
bright 12.9
face 12.8
casual 12.7
physician 12.7
confidence 12.5
businesspeople 12.3
lifestyle 12.3
meeting 12.3
human 12
healthy 12
20s 11.9
general practitioner 11.9
horizontal 11.7
color 11.7
middle aged 11.7
workers 11.7
practice 11.6
attractive 11.2
corporate 11.2
treatment 11
friendly 11
businesswoman 10.9
clinician 10.9
surgical 10.8
expert 10.8
associates 10.8
coworkers 10.8
suit 10.8
diagnosis 10.8
ill 10.7
health care 10.7
two 10.2
student 10.2
crew 9.8
heal 9.8
healing 9.8
good mood 9.8
success 9.7
desk 9.5
successful 9.2
holding 9.1
old 9.1
technology 8.9
businessmen 8.8
couple 8.7
women 8.7
sick 8.7
four 8.6
exam 8.6
serious 8.6
modern 8.4
inside 8.3
computer 8
look 7.9
fifties 7.9
forties 7.9
50s 7.8
medication 7.8
thirties 7.8
assistant 7.8
examination 7.8
lab 7.8
cooperation 7.7
sitting 7.7
partnership 7.7
lady 7.3
laptop 7.3
aged 7.2
day 7.1
together 7

Google
created on 2019-03-26

Photograph 97.3
Social group 92.8
Team 87.7
Snapshot 82
Event 71.1
Gentleman 70.1
Black-and-white 68.3
Crew 64.7
Photography 62.4
Formal wear 60.8
Suit 56.8
Uniform 52.8

Microsoft
created on 2019-03-26

wall 99.8
posing 98.4
person 98.1
group 79.7
sport 69.9
team 19.8
tournament 15.4
competition 14.7
karate 9.8

Face analysis

Amazon

AWS Rekognition

Age 30-47
Gender Male, 95.7%
Angry 4.4%
Sad 4%
Confused 2.2%
Surprised 1.9%
Calm 85%
Disgusted 1.2%
Happy 1.4%

AWS Rekognition

Age 30-47
Gender Female, 60%
Disgusted 0.5%
Calm 4.1%
Angry 4.9%
Happy 85.2%
Sad 2.6%
Surprised 1.9%
Confused 0.8%

AWS Rekognition

Age 45-66
Gender Male, 93.6%
Sad 7.6%
Angry 1.7%
Happy 2.6%
Disgusted 2.4%
Surprised 2.2%
Confused 1.4%
Calm 82.1%

AWS Rekognition

Age 26-43
Gender Male, 92.4%
Disgusted 2.3%
Sad 4%
Surprised 3.8%
Happy 3.8%
Angry 10.5%
Calm 72.9%
Confused 2.6%

AWS Rekognition

Age 35-52
Gender Male, 98.9%
Disgusted 0.3%
Sad 2.6%
Angry 1.2%
Happy 0.4%
Calm 93.8%
Confused 1.1%
Surprised 0.6%

AWS Rekognition

Age 26-44
Gender Male, 99.3%
Disgusted 10.3%
Calm 71.7%
Confused 2.4%
Sad 4.3%
Happy 5%
Surprised 4.4%
Angry 2%

AWS Rekognition

Age 35-52
Gender Male, 99.6%
Angry 3.7%
Calm 67.3%
Confused 2.4%
Happy 0.9%
Disgusted 0.7%
Surprised 1.1%
Sad 24%

AWS Rekognition

Age 35-52
Gender Male, 91.4%
Angry 2%
Disgusted 1.5%
Calm 83.3%
Sad 5.9%
Surprised 2.6%
Confused 2.1%
Happy 2.6%

AWS Rekognition

Age 26-43
Gender Male, 89.2%
Happy 17.4%
Surprised 4.9%
Sad 3.9%
Disgusted 1.6%
Angry 2.4%
Confused 2.7%
Calm 67%

AWS Rekognition

Age 26-43
Gender Male, 80.6%
Disgusted 1.1%
Sad 10.9%
Surprised 5.7%
Calm 22.6%
Happy 49.8%
Confused 3.1%
Angry 6.8%

AWS Rekognition

Age 38-59
Gender Male, 98.5%
Disgusted 3.8%
Surprised 1.6%
Angry 1.3%
Confused 1.8%
Sad 1.8%
Calm 88.3%
Happy 1.4%

AWS Rekognition

Age 26-43
Gender Male, 99%
Calm 51.7%
Confused 1.7%
Sad 2.4%
Angry 3%
Happy 36.8%
Surprised 2.9%
Disgusted 1.6%

AWS Rekognition

Age 26-43
Gender Male, 89.3%
Angry 9.9%
Calm 57.4%
Confused 4.1%
Disgusted 2.2%
Surprised 8.7%
Sad 5%
Happy 12.6%

Feature analysis

Amazon

Tie 99.9%
Person 99.5%
Suit 83.5%
Sunglasses 74.2%

Captions

Microsoft

a group of people posing for a photo 97.6%
a group of people posing for the camera 97.5%
a group of people posing for a picture 97.4%