Human Generated Data

Title

Untitled (portrait of parents and three sons)

Date

1915

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2147

Human Generated Data

Title

Untitled (portrait of parents and three sons)

People

Artist: Hamblin Studio, American active 1930s

Date

1915

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2147

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 98.9
Apparel 98.9
Person 98.2
Human 98.2
Person 96.8
Person 96.8
Person 96.1
Person 95.5
Overcoat 94.1
Coat 94.1
Accessory 94
Accessories 94
Tie 94
People 91.4
Shirt 81.9
Face 77.7
Suit 73.1
Family 69.8
Tuxedo 69.4
Photo 64.5
Photography 64.5
Portrait 63.9
Tie 63.6

Clarifai
created on 2019-06-01

people 100
adult 99
group 98.8
man 98.8
group together 97.9
portrait 95.5
wear 94.5
leader 93
three 91.8
four 88.8
medical practitioner 86.8
administration 86.6
facial expression 84.9
several 84.4
many 84
two 79
partnership 78.4
woman 75.4
five 74.1
actor 73.7

Imagga
created on 2019-06-01

groom 58.8
man 55.3
doctor 50.8
male 47.6
professional 43.4
person 42.9
medical 42.4
hospital 40.6
coat 40.4
adult 38.8
lab coat 37.3
job 35.4
businessman 35.3
team 35
people 33.5
medicine 33.5
clinic 31.6
business 31.6
happy 31.4
health 30.6
stethoscope 30.5
care 30.5
occupation 30.3
portrait 28.5
smiling 28.2
colleagues 28.2
office 28.1
nurse 27.9
work 26.7
group 26.6
looking 25.6
worker 25.5
practitioner 24.8
confident 24.6
doctors 22.6
uniform 21.9
businesspeople 21.8
men 21.5
handsome 21.4
smile 21.4
teamwork 21.3
corporate 20.6
success 20.1
indoor 20.1
specialist 19.7
clinical 19.6
mature 18.6
indoors 18.5
successful 18.3
businesswoman 18.2
patient 18
face 17.8
elderly 17.3
30s 16.4
profession 16.3
illness 16.2
executive 16.2
meeting 16
working 15.9
camera 14.8
coworkers 14.7
staff 14.4
attractive 14
standing 13.9
cheerful 13.8
consultant 13.6
expertise 13.6
laboratory 13.5
horizontal 13.4
senior 13.1
lifestyle 13
friendly 12.8
color 12.8
crew 12.8
associates 12.8
good mood 12.7
happiness 12.5
bright 12.2
bride 12.1
healing 12.1
computer 12
20s 11.9
casual 11.9
general practitioner 11.9
40s 11.7
partners 11.7
health care 11.7
cooperation 11.6
mid adult 11.6
suit 11.2
laptop 10.9
garment 10.9
clinician 10.9
expert 10.8
heal 10.8
assistant 10.7
exam 10.5
company 10.2
newlywed 10
diagnosis 9.8
ill 9.7
workers 9.7
clothing 9.6
women 9.5
desk 9.5
expression 9.4
two 9.3
manager 9.3
student 9.1
human 9
examining 8.8
medication 8.8
physician 8.8
businessmen 8.8
examination 8.8
couple 8.7
practice 8.7
partner 8.7
corporation 8.7
research 8.6
smart 8.5
glasses 8.3
positive 8.3
together 7.9
look 7.9
black 7.8
sick 7.7
partnership 7.7
old 7.7
formal 7.6
hand 7.6
career 7.6
healthy 7.6
surgeon 7.6
spouse 7.5
holding 7.4
treatment 7.4
day 7.1
modern 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wall 97.8
posing 97.7
person 90
human face 86.3
black and white 82.5
old 81.4
smile 81.1
man 79.8
white 70.8
clothing 68.9
group 61.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 94.8%
Angry 1.6%
Disgusted 1.7%
Happy 3.3%
Sad 2.6%
Surprised 1.8%
Calm 85.7%
Confused 3.2%

AWS Rekognition

Age 20-38
Gender Male, 85%
Happy 1.8%
Confused 2%
Angry 1.5%
Disgusted 1.7%
Surprised 2.2%
Sad 3.5%
Calm 87.4%

AWS Rekognition

Age 30-47
Gender Male, 84.8%
Sad 7.2%
Surprised 2.7%
Disgusted 5.7%
Angry 3.4%
Calm 73.7%
Happy 2.7%
Confused 4.7%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Sad 7.2%
Calm 71.8%
Surprised 5.3%
Angry 4.1%
Disgusted 2.4%
Happy 4.7%
Confused 4.6%

AWS Rekognition

Age 20-38
Gender Female, 70.4%
Surprised 7.8%
Happy 4.1%
Disgusted 3%
Calm 57.1%
Sad 12.8%
Confused 7.7%
Angry 7.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Tie 94%
Suit 73.1%

Categories