Human Generated Data

Title

Untitled (large family portrait with nun seated in center )

Date

1934

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4157

Human Generated Data

Title

Untitled (large family portrait with nun seated in center )

People

Artist: Durette Studio, American 20th century

Date

1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Person 99.4
Person 99.3
Person 99.1
Person 99
Person 99
Person 98.9
Person 98.9
Person 98.8
Person 98.7
Person 98.3
Person 98.3
Person 97.4
Person 97.3
Person 96.4
Accessory 83
Tie 83
Accessories 83
People 82
Clothing 80.7
Apparel 80.7
Tie 79.9
Face 79.6
Tie 65.4
Nurse 62.3
Clinic 59.7

Clarifai
created on 2019-06-01

people 99.8
group 99.5
group together 99
many 96.9
adult 96.6
man 96.1
woman 93.1
leader 92.3
several 92.2
uniform 88.5
wear 87.5
medical practitioner 85.5
child 77.1
education 76.1
administration 75.7
outfit 75.6
five 73.5
portrait 71.1
scientist 70.5
four 69.4

Imagga
created on 2019-06-01

nurse 100
people 36.2
man 34.9
happy 30.7
person 30.7
male 29.1
smiling 28.9
adult 28.9
team 27.8
doctor 26.3
medical 24.7
hospital 24.6
professional 24.1
group 22.6
men 22.3
worker 21.6
business 21.2
businessman 21.2
indoors 21.1
portrait 20.7
job 20.3
medicine 20.2
couple 20
women 19.8
smile 18.5
30s 18.3
groom 17.8
teamwork 17.6
colleagues 17.5
health 17.4
patient 17.3
kin 17.3
businesswoman 17.3
work 17.3
mature 16.7
together 16.6
occupation 16.5
clinic 16.4
uniform 16.1
standing 15.6
office 15.3
businesspeople 15.2
home 15.2
happiness 14.9
40s 14.6
care 14
two 13.5
family 13.3
cheerful 13
camera 12.9
coat 12.8
doctors 12.8
casual 12.7
mid adult 12.5
lifestyle 12.3
room 12.2
corporate 12
day 11.8
clinical 11.7
working 11.5
talking 11.4
senior 11.2
sitting 11.2
confident 10.9
stethoscope 10.9
50s 10.8
meeting 10.4
20s 10.1
indoor 10
lab coat 10
color 10
bride 9.9
clothing 9.8
attractive 9.8
old 9.7
expertise 9.7
four 9.6
elderly 9.6
staff 9.6
modern 9.1
associates 8.8
mother 8.8
looking 8.8
life 8.7
love 8.7
partnership 8.6
illness 8.6
face 8.5
inside 8.3
wedding 8.3
human 8.2
successful 8.2
girls 8.2
new 8.1
suit 8.1
handsome 8
employee 8
four people 7.9
coworkers 7.9
discussing 7.9
consultant 7.8
discussion 7.8
middle aged 7.8
thirties 7.8
examination 7.8
workers 7.8
laboratory 7.7
profession 7.7
house 7.5
practitioner 7.4
success 7.2
dress 7.2

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 99.1
clothing 82.7
smile 81.6
woman 78.6
posing 76
group 67.1
wedding dress 66.4
old 59.1
team 32.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52%
Confused 1.2%
Surprised 1.3%
Calm 86.4%
Sad 5.7%
Happy 2.6%
Disgusted 0.5%
Angry 2.4%

AWS Rekognition

Age 23-38
Gender Male, 54.2%
Happy 47.5%
Angry 46%
Surprised 46.3%
Disgusted 45.4%
Sad 46.2%
Calm 47.2%
Confused 46.5%

AWS Rekognition

Age 20-38
Gender Male, 52.3%
Calm 52%
Surprised 45.3%
Disgusted 45.1%
Happy 45.5%
Sad 46.4%
Confused 45.3%
Angry 45.3%

AWS Rekognition

Age 29-45
Gender Female, 51%
Happy 52.8%
Disgusted 45.1%
Sad 45.3%
Surprised 45.5%
Angry 45.8%
Calm 45.2%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Disgusted 45.5%
Confused 45.5%
Angry 45.5%
Calm 46.8%
Surprised 45.8%
Happy 49.1%
Sad 46.8%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Angry 45.2%
Sad 45.3%
Happy 46%
Calm 53%
Confused 45.1%
Disgusted 45.1%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53%
Disgusted 45%
Calm 45.1%
Angry 45.2%
Sad 45.1%
Happy 54.6%
Surprised 45.1%
Confused 45%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Angry 45.2%
Sad 46.9%
Surprised 45.2%
Happy 52.2%
Calm 45.2%
Disgusted 45.1%
Confused 45.2%

AWS Rekognition

Age 17-27
Gender Female, 52.4%
Confused 45.4%
Surprised 45.6%
Happy 50.2%
Angry 45.2%
Sad 46.3%
Disgusted 45.1%
Calm 47.1%

AWS Rekognition

Age 26-43
Gender Male, 53.2%
Disgusted 45.2%
Calm 48.9%
Angry 45.3%
Sad 45.5%
Surprised 45.6%
Happy 49.1%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Male, 51.2%
Confused 45.3%
Disgusted 45.3%
Happy 49%
Surprised 45.7%
Calm 49%
Sad 45.4%
Angry 45.3%

AWS Rekognition

Age 23-38
Gender Female, 54%
Happy 53.2%
Sad 45.1%
Confused 45.2%
Angry 45.2%
Disgusted 45.1%
Surprised 45.4%
Calm 45.8%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Angry 45.2%
Surprised 45.2%
Disgusted 45.1%
Sad 45.2%
Calm 46.9%
Happy 52.1%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Confused 45.3%
Surprised 45.4%
Happy 45.7%
Calm 49.9%
Sad 45.7%
Disgusted 45.1%
Angry 47.9%

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Happy 52.8%
Confused 45.2%
Angry 45.7%
Sad 45.6%
Calm 45.5%
Surprised 45.2%
Disgusted 45.1%

Feature analysis

Amazon

Person 99.6%
Tie 83%

Captions

Microsoft

a group of people posing for a photo 94.2%
a group of people posing for the camera 94.1%
a group of people posing for a picture 94%

Text analysis

Amazon

as