Human Generated Data

Title

Untitled (portrait of six men in suits)

Date

1915

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2172

Human Generated Data

Title

Untitled (portrait of six men in suits)

People

Artist: Hamblin Studio, American active 1930s

Date

1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.2
Clothing 99.2
Tie 98.6
Accessory 98.6
Accessories 98.6
Person 97.8
Human 97.8
Person 97.6
Person 96.8
Overcoat 94.3
Coat 94.3
Person 94.3
Shirt 93.2
Person 92.9
Person 86
Suit 84.8
Suit 83.2
Tuxedo 81.7
Tie 79.7
Tie 77.3
Tie 76.2
Face 71
Dress Shirt 69.6
People 66
Suit 66
Clinic 64.3
Lab Coat 55.9

Clarifai
created on 2019-06-01

people 99.8
man 99.4
group 98.7
group together 96.7
adult 96.5
portrait 93.3
leader 90.1
three 87.8
facial expression 87.1
woman 86.9
four 86.4
five 85.1
monochrome 79.7
bald 78.3
medical practitioner 77.2
several 77.1
many 76.5
wear 74.8
partnership 73.6
business 67.9

Imagga
created on 2019-06-01

lab coat 54.3
man 50.4
coat 48.8
doctor 44.2
person 44.1
male 44
adult 38.1
medical 38
hospital 37.6
professional 36.5
nurse 32.8
people 32.4
stethoscope 31.1
job 29.2
happy 28.8
portrait 28.5
businessman 28.3
business 28
medicine 27.3
care 27.2
smiling 26.8
team 26
worker 24.6
health 24.3
colleagues 24.3
looking 24
occupation 23.8
work 22.8
office 22.5
groom 21.8
doctors 21.6
mature 21.4
clinic 21.1
uniform 21
group 21
men 20.6
handsome 20.5
confident 20
smile 20
garment 19.3
standing 19.1
businesspeople 19
attractive 18.9
profession 18.2
businesswoman 17.3
elderly 17.2
staff 17.2
corporate 17.2
senior 16.9
teamwork 16.7
30s 16.4
golfer 15.2
patient 15
indoors 14.9
couple 14.8
practitioner 14.8
clinical 14.7
clothing 14.7
specialist 14.4
associates 13.8
successful 13.7
indoor 13.7
consultant 13.6
workers 13.6
cooperation 13.5
human 13.5
illness 13.4
suit 13.2
cheerful 13
camera 12.9
success 12.9
20s 12.8
face 12.8
coworkers 12.8
women 12.7
expertise 12.6
mid adult 12.5
happiness 12.5
meeting 12.3
player 11.7
working 11.5
casual 11
crew 10.8
black 10.8
physician 10.7
bright 10.7
healthy 10.7
color 10.6
confidence 10.5
together 10.5
computer 10.4
executive 10.4
day 10.2
two 10.2
friendly 10.1
modern 9.8
good mood 9.8
40s 9.7
assistant 9.7
desk 9.5
lifestyle 9.4
secretary 9.4
contestant 9.2
bride 9.2
laptop 9.1
old 9.1
general practitioner 8.9
expert 8.9
partners 8.8
health care 8.7
corporation 8.7
laboratory 8.7
formal 8.6
tie 8.5
healing 8.2
light 8
family 8
clinician 7.9
fifties 7.9
general 7.9
heal 7.9
brunette 7.8
50s 7.8
25 30 years 7.8
businessmen 7.8
thirties 7.8
partnership 7.7
employee 7.7
guy 7.6
horizontal 7.5
one 7.5
manager 7.5
positive 7.4
lady 7.3
building 7.1
colleague 7
pretty 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 98.2
posing 96.8
person 90.7
human face 83.3
smile 80.4
standing 79.6
old 75.5
black and white 72
man 70.9
group 60.8
suit 36.7

Face analysis

Amazon

AWS Rekognition

Age 19-36
Gender Female, 72.8%
Angry 6.6%
Happy 18.6%
Confused 6.8%
Calm 21.7%
Surprised 8.8%
Sad 24.6%
Disgusted 12.9%

AWS Rekognition

Age 15-25
Gender Male, 70%
Calm 86.7%
Surprised 1.6%
Sad 6.1%
Confused 1.4%
Disgusted 1.7%
Happy 1.2%
Angry 1.4%

AWS Rekognition

Age 30-47
Gender Male, 86.6%
Disgusted 1.2%
Sad 85.2%
Calm 9.1%
Confused 1.1%
Surprised 1%
Happy 0.8%
Angry 1.7%

AWS Rekognition

Age 23-38
Gender Male, 81.2%
Sad 12.4%
Happy 8.6%
Surprised 9%
Calm 52.5%
Disgusted 3.8%
Confused 9.6%
Angry 4.1%

AWS Rekognition

Age 26-43
Gender Male, 96%
Disgusted 5.6%
Sad 5.3%
Surprised 7.1%
Happy 10.2%
Angry 6.7%
Calm 36.1%
Confused 29%

AWS Rekognition

Age 14-25
Gender Male, 98.1%
Angry 3.9%
Disgusted 4.3%
Confused 7.5%
Calm 65.2%
Sad 10.1%
Surprised 3.9%
Happy 5.1%

Feature analysis

Amazon

Tie 98.6%
Person 97.8%
Suit 84.8%

Captions

Microsoft

a group of people posing for a photo 98.2%
a group of people posing for the camera 98.1%
a group of people posing for a picture 98%