Human Generated Data

Title

Untitled (studio portrait of men in graduating class with reverend)
Date

c. 1934, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5853

Human Generated Data

Title

Untitled (studio portrait of men in graduating class with reverend)

People

Artist: Durette Studio, American 20th century

Date

c. 1934, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Audience 99.5
Crowd 99.5
Human 99.5
Person 98.9
Person 98.9
Person 98.2
Person 97.8
Person 97.4
Person 97.1
Person 94.3
Person 91.3
Footwear 84.3
Clothing 84.3
Apparel 84.3
Shoe 84.3
Room 83.1
School 83.1
Indoors 83.1
Classroom 83.1
Shoe 82.6
Person 82
Person 77
Shoe 76.8
Sitting 75.4
People 74.3
Accessory 67.2
Tie 67.2
Accessories 67.2
Speech 64
Shoe 59
Shoe 56.6
Shoe 52.9
Person 50.1
Person 49.3

Clarifai
created on 2019-11-16

people 99.4
group 99.4
many 99
group together 99
woman 95.6
adult 95
band 92.9
crowd 92.2
child 91.5
leader 91.3
man 91.1
music 90.3
musician 90
education 89.5
school 89.2
singer 89.1
wear 87.2
portrait 85.5
chair 81.3
military 77.6

Imagga
created on 2019-11-16

brass 54.4
wind instrument 49.9
musical instrument 34.2
people 32.3
cornet 30
group 26.6
business 23.1
man 22.9
outfit 22.9
crowd 22.1
male 19.8
women 19
oboe 18.6
men 18
silhouette 17.4
adult 15.6
person 15.6
businessman 15
black 14.1
trombone 12.9
team 12.5
work 11.8
meeting 11.3
music 11
city 10.8
travel 10.5
party 10.3
suit 10
concert 9.7
silhouettes 9.7
success 9.6
urban 9.6
corporate 9.4
device 9.3
horn 9
human 9
posing 8.9
classroom 8.7
walking 8.5
manager 8.4
life 8.3
room 8.3
event 8.3
fashion 8.3
girls 8.2
body 8
job 8
woodwind 7.7
outline 7.6
fun 7.5
teamwork 7.4
executive 7.4
occupation 7.3
office 7.2
collection 7.2
celebration 7.2
interior 7.1
clothing 7
modern 7
together 7

Google
created on 2019-11-16

Black-and-white 68.3
Art 62.5
Team 52.3

Microsoft
created on 2019-11-16

person 99.3
clothing 98.7
posing 97
group 95.9
man 94.1
text 87.5
suit 86.9
footwear 85.2
smile 79.5
old 76.4
furniture 71.8
woman 71.5
chair 62.2
black and white 61.5
people 57.4
crowd 0.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 50.6%
Sad 45.1%
Surprised 45%
Angry 45%
Confused 45%
Fear 45%
Happy 45%
Calm 54.9%
Disgusted 45%

AWS Rekognition

Age 6-16
Gender Male, 54.4%
Confused 45%
Angry 45%
Surprised 45%
Calm 52.5%
Disgusted 45%
Fear 45%
Sad 45.2%
Happy 47.2%

AWS Rekognition

Age 12-22
Gender Male, 53.7%
Confused 45%
Surprised 45%
Calm 54.7%
Fear 45%
Disgusted 45%
Happy 45%
Sad 45.2%
Angry 45%

AWS Rekognition

Age 12-22
Gender Male, 54.4%
Disgusted 45%
Calm 55%
Surprised 45%
Fear 45%
Happy 45%
Confused 45%
Sad 45%
Angry 45%

AWS Rekognition

Age 5-15
Gender Male, 54.1%
Disgusted 46.2%
Happy 45.1%
Confused 45.3%
Angry 45.3%
Fear 45.4%
Sad 45.1%
Calm 52%
Surprised 45.5%

AWS Rekognition

Age 13-23
Gender Male, 52.2%
Calm 54.9%
Fear 45%
Disgusted 45%
Surprised 45%
Happy 45%
Angry 45%
Confused 45.1%
Sad 45%

AWS Rekognition

Age 13-23
Gender Male, 54.7%
Fear 45%
Happy 45%
Confused 45%
Calm 55%
Disgusted 45%
Sad 45%
Angry 45%
Surprised 45%

AWS Rekognition

Age 23-37
Gender Male, 53.4%
Angry 45%
Fear 45%
Calm 55%
Sad 45%
Disgusted 45%
Happy 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 17-29
Gender Female, 52%
Happy 45.2%
Fear 45%
Angry 45.1%
Confused 45%
Calm 54.5%
Disgusted 45.1%
Surprised 45%
Sad 45%

AWS Rekognition

Age 15-27
Gender Male, 52.1%
Happy 45%
Angry 45.1%
Disgusted 45.1%
Calm 54%
Fear 45%
Surprised 45.1%
Confused 45.1%
Sad 45.5%

AWS Rekognition

Age 20-32
Gender Male, 50.7%
Calm 46.6%
Confused 45.1%
Happy 45%
Disgusted 45.2%
Surprised 45.1%
Sad 45.1%
Fear 45%
Angry 52.9%

AWS Rekognition

Age 5-15
Gender Male, 51.4%
Sad 45.3%
Happy 45.2%
Fear 46.5%
Calm 49.5%
Angry 46.7%
Disgusted 45.1%
Confused 45.1%
Surprised 46.8%

AWS Rekognition

Age 8-18
Gender Male, 54.6%
Calm 45.4%
Surprised 45%
Angry 45%
Confused 45%
Happy 54.5%
Fear 45%
Sad 45%
Disgusted 45%

AWS Rekognition

Age 3-9
Gender Female, 53.8%
Disgusted 45%
Happy 45%
Angry 45%
Fear 45.5%
Sad 54%
Surprised 45%
Confused 45%
Calm 45.4%

AWS Rekognition

Age 13-25
Gender Male, 54.2%
Happy 53%
Sad 45%
Disgusted 45%
Calm 46.9%
Angry 45%
Surprised 45%
Fear 45%
Confused 45%

AWS Rekognition

Age 27-43
Gender Female, 53%
Happy 45.2%
Confused 45%
Calm 54.7%
Angry 45%
Disgusted 45%
Surprised 45%
Fear 45%
Sad 45.1%

AWS Rekognition

Age 28-44
Gender Male, 54.9%
Angry 45.7%
Sad 45.2%
Calm 52.5%
Fear 45.1%
Happy 45.9%
Surprised 45.1%
Disgusted 45.4%
Confused 45.1%

AWS Rekognition

Age 12-22
Gender Male, 54.3%
Surprised 45%
Disgusted 45%
Sad 45%
Angry 45%
Calm 55%
Happy 45%
Fear 45%
Confused 45%

AWS Rekognition

Age 11-21
Gender Male, 53.7%
Calm 54.6%
Sad 45.1%
Happy 45.1%
Angry 45.1%
Fear 45%
Surprised 45.1%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 13-25
Gender Male, 54.5%
Happy 45%
Angry 45%
Fear 45%
Surprised 45.2%
Calm 54.6%
Sad 45%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 15-27
Gender Female, 50.1%
Calm 54.5%
Happy 45%
Angry 45.1%
Disgusted 45%
Surprised 45%
Fear 45%
Sad 45.3%
Confused 45%

AWS Rekognition

Age 13-23
Gender Male, 50.5%
Happy 45%
Disgusted 45%
Confused 45%
Calm 51%
Fear 45%
Sad 45.2%
Angry 48.7%
Surprised 45%

AWS Rekognition

Age 12-22
Gender Male, 54.5%
Angry 45%
Calm 54.8%
Fear 45%
Disgusted 45%
Surprised 45%
Happy 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 20-32
Gender Male, 51.9%
Happy 45%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45%
Surprised 45%
Calm 54.9%
Angry 45%

AWS Rekognition

Age 8-18
Gender Male, 53.6%
Fear 45%
Sad 45.4%
Surprised 45.1%
Angry 45.2%
Disgusted 49.4%
Confused 45.1%
Happy 45%
Calm 49.7%

AWS Rekognition

Age 15-27
Gender Male, 53.1%
Disgusted 45%
Happy 45.1%
Surprised 45.1%
Sad 45%
Fear 45%
Calm 54.8%
Angry 45%
Confused 45.1%

AWS Rekognition

Age 12-22
Gender Male, 51.9%
Angry 45%
Surprised 45%
Sad 45%
Happy 45%
Disgusted 45%
Confused 45%
Calm 54.8%
Fear 45%

AWS Rekognition

Age 7-17
Gender Male, 52.2%
Fear 45%
Happy 45%
Confused 45.1%
Calm 54.8%
Disgusted 45%
Sad 45.1%
Angry 45%
Surprised 45%

AWS Rekognition

Age 5-15
Gender Female, 52.3%
Happy 54.3%
Sad 45.1%
Disgusted 45%
Fear 45%
Calm 45.4%
Angry 45%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 5-15
Gender Male, 53.3%
Happy 45%
Surprised 45%
Angry 45%
Fear 45%
Sad 45%
Confused 45%
Calm 54.8%
Disgusted 45%

AWS Rekognition

Age 12-22
Gender Male, 50.1%
Angry 45%
Sad 45%
Happy 45%
Disgusted 45%
Calm 54.9%
Confused 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 12-22
Gender Female, 51.2%
Angry 45.1%
Happy 45%
Fear 45%
Disgusted 45%
Sad 46%
Calm 53.7%
Surprised 45%
Confused 45.1%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 84.3%
Tie 67.2%

Captions

Microsoft

a group of people posing for a photo 98.4%
a group of people posing for the camera 98.3%
a group of people posing for a picture 98.2%