Human Generated Data

Title

Untitled (studio portrait of twelve member family)

Date

c. 1953

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11143

Human Generated Data

Title

Untitled (studio portrait of twelve member family)

People

Artist: Claseman Studio, American 20th century

Date

c. 1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Person 99.4
Human 99.4
Person 99.3
Accessory 98.9
Tie 98.9
Accessories 98.9
Person 98.7
Tie 97.4
Person 96.9
Tie 96.9
Person 96.6
Person 96.3
Person 95.9
Person 95.6
Person 95.5
Apparel 95.1
Clothing 95.1
Person 94.8
Face 93
Head 91.5
Person 90.3
Overcoat 86.7
Suit 86.7
Coat 86.7
Tie 85.4
Tie 85.4
Suit 85.2
People 84.5
Tie 84.2
Person 82.6
Jaw 74.4
Suit 70.1
Suit 69.4
Crowd 64.6
Jury 64.2
Jacket 61.7
Blazer 61.7
Suit 60
Tie 57.7
Tuxedo 57.2
Family 55.1

Clarifai
created on 2019-03-26

man 99.4
people 98.8
group 98.3
group together 97.9
achievement 94.9
four 94.8
five 94.8
many 94
woman 93.4
partnership 92.7
togetherness 92.1
business 91.9
teamwork 90.9
unity 90.7
portrait 90.3
cooperation 89.6
victory 88.1
three 87.2
success 85.9
leader 84.5

Imagga
created on 2019-03-26

golfer 100
player 100
contestant 92.5
person 70.7
doctor 58.2
man 52.4
medical 51.2
hospital 47
stethoscope 43.9
male 43.2
professional 43.1
nurse 37.9
medicine 35.2
adult 33
care 32.9
people 32.9
team 32.2
business 32.2
health 31.9
job 31.8
happy 31.3
clinic 30.6
occupation 30.2
mature 29.7
uniform 29.4
portrait 28.5
smiling 28.2
smile 27.1
coat 27
businessman 26.5
confident 26.4
work 25.9
men 24.9
practitioner 24.8
looking 24.8
doctors 23.6
handsome 22.3
profession 22
surgeon 20.5
standing 20
clinical 19.5
successful 19.2
elderly 19.1
specialist 18.9
senior 18.7
worker 18.7
working 18.6
colleagues 18.4
30s 18.3
group 17.7
success 16.9
teamwork 16.7
patient 16.5
physician 14.6
healthy 14.5
office 14.4
suit 14.4
ill 13.6
laboratory 13.5
staff 13.4
illness 13.3
human 12.7
expertise 12.6
practice 12.6
sick 12.5
confidence 12.4
businesspeople 12.3
indoors 12.3
lifestyle 12.3
lab coat 12.3
friendly 11.9
40s 11.7
health care 11.6
bright 11.4
student 11.1
camera 11.1
20s 11
mid adult 10.6
corporate 10.3
aged 9.9
cheerful 9.8
old 9.7
consultant 9.7
isolate 9.5
women 9.5
happiness 9.4
executive 9.2
treatment 9.2
technology 8.9
color 8.9
general 8.8
thirties 8.8
older 8.7
workers 8.7
exam 8.6
tie 8.5
meeting 8.5
attractive 8.4
holding 8.2
indoor 8.2
natural 8
light 8
building 7.9
general practitioner 7.9
businessmen 7.8
middle aged 7.8
assistant 7.8
partner 7.7
r 7.7
partnership 7.7
serious 7.6
casual 7.6
studio 7.6
hand 7.6
baron 7.5
one 7.5
company 7.4
positive 7.4
lady 7.3
laptop 7.3
life 7.2
modern 7

Google
created on 2019-03-26

Photograph 95.3
Team 92.3
Crew 68.5
Photography 62.4
Black-and-white 56.4

Microsoft
created on 2019-03-26

posing 99.6
person 99.6
wall 99.6
group 90.8
people 58.3
female 39.3
tournament 10.5
competition 4.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 97%
Sad 13.5%
Calm 81.1%
Confused 1%
Disgusted 0.4%
Angry 1.3%
Happy 2%
Surprised 0.7%

AWS Rekognition

Age 26-43
Gender Male, 99.2%
Angry 8.4%
Disgusted 1.7%
Surprised 6.4%
Calm 64.7%
Sad 5.8%
Happy 7.7%
Confused 5.2%

AWS Rekognition

Age 20-38
Gender Male, 98.3%
Happy 1.2%
Confused 1.5%
Calm 56%
Surprised 1%
Sad 37.9%
Angry 2.1%
Disgusted 0.3%

AWS Rekognition

Age 26-43
Gender Male, 94.8%
Calm 70.2%
Happy 5.8%
Angry 5.2%
Confused 2.9%
Disgusted 2%
Surprised 3.6%
Sad 10.3%

AWS Rekognition

Age 26-43
Gender Male, 96.1%
Confused 3.1%
Disgusted 0.9%
Happy 3.4%
Calm 81.5%
Angry 2.7%
Surprised 3.2%
Sad 5.2%

AWS Rekognition

Age 26-43
Gender Female, 79.4%
Calm 80.2%
Confused 1.3%
Happy 6.8%
Sad 5.5%
Angry 2.3%
Surprised 2.6%
Disgusted 1.3%

AWS Rekognition

Age 26-43
Gender Female, 87.8%
Calm 31.5%
Confused 5.5%
Surprised 5.6%
Sad 39.2%
Angry 4.8%
Disgusted 1.3%
Happy 12.2%

AWS Rekognition

Age 35-52
Gender Male, 99.5%
Disgusted 0.3%
Happy 0.8%
Surprised 0.6%
Angry 1.4%
Sad 5.9%
Confused 1.3%
Calm 89.7%

AWS Rekognition

Age 26-43
Gender Female, 83%
Happy 50.6%
Calm 8.4%
Disgusted 2.5%
Surprised 3%
Confused 3.4%
Angry 4%
Sad 28%

AWS Rekognition

Age 26-43
Gender Female, 82.4%
Calm 61.1%
Confused 6.6%
Happy 10%
Sad 11.4%
Angry 2.4%
Surprised 4.5%
Disgusted 3.9%

AWS Rekognition

Age 26-43
Gender Female, 95.5%
Happy 4.8%
Confused 1.7%
Calm 81.7%
Surprised 3.6%
Sad 5%
Angry 2.1%
Disgusted 1%

AWS Rekognition

Age 26-43
Gender Female, 91.8%
Sad 6.2%
Happy 86.1%
Disgusted 0.7%
Calm 1.3%
Angry 1.7%
Confused 1.7%
Surprised 2.2%

Feature analysis

Amazon

Person 99.4%
Tie 98.9%
Suit 86.7%

Captions

Microsoft

a group of people posing for a photo 97.9%
a group of people posing for the camera 97.8%
a group of people posing for a picture 97.7%