Human Generated Data

Title

Untitled (portrait of seventeen women standing with uniforms, hats (I.O.F.), and cloaks)

Date

1938

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4062

Human Generated Data

Title

Untitled (portrait of seventeen women standing with uniforms, hats (I.O.F.), and cloaks)

People

Artist: Durette Studio, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99
Human 99
Clothing 98.9
Apparel 98.9
Footwear 98.9
Shoe 98.9
Person 98.9
Shoe 98.6
Person 98.5
Person 98.3
Person 98.2
Shorts 97.2
Shoe 96.9
Person 96.3
Shoe 96.3
Shoe 96.2
Shoe 93.5
Helmet 92.1
Shoe 92
Military 90.6
Shoe 90.1
Military Uniform 89.7
Shoe 88.1
Shoe 84.5
People 83.3
Officer 76.8
Helmet 76.1
Helmet 75.7
Person 73.9
Sailor Suit 73.1
Crowd 70.7
Helmet 69.7
Person 69.5
Person 68.5
Helmet 66
Person 63.9
Person 60.1
Soldier 56.5
Marching 56.4
Person 55.5

Clarifai
created on 2019-06-01

people 99.8
woman 99
group together 98.3
man 98.3
adult 98.2
group 97.6
uniform 96.8
wear 96.6
many 94.7
outfit 93.4
crowd 91
portrait 90.3
squad 88.8
child 88.2
dress 86.8
girl 86.7
school 86
cooperation 84.6
education 80.8
retro 80.1

Imagga
created on 2019-06-01

people 32.3
person 29.3
man 24.3
adult 22.4
male 22
nurse 20.4
group 20.1
brass 19.6
professional 19.4
businessman 18.5
dress 18.1
outfit 18
human 18
medical 17.6
business 16.4
men 16.3
wind instrument 16.1
golfer 15.4
black 15.1
happy 15
team 14.3
work 14.1
clothing 13.5
doctor 13.1
teamwork 13
portrait 12.9
fashion 12.8
body 12.8
silhouette 12.4
medicine 12.3
cornet 12.2
player 11.9
worker 11.8
health 11.8
elegance 11.7
crowd 11.5
job 11.5
couple 11.3
women 11.1
occupation 11
contestant 10.8
anatomy 10.6
musical instrument 10.6
success 10.5
party 10.3
happiness 10.2
bride 10.1
suit 10.1
hand 9.9
together 9.6
standing 9.6
model 9.3
uniform 9.3
attractive 9.1
looking 8.8
smiling 8.7
groom 8.7
corporate 8.6
businesswoman 8.2
staff 8.1
lady 8.1
dance 8.1
family 8
science 8
posing 8
celebration 8
smile 7.8
face 7.8
skeleton 7.8
trombone 7.7
modern 7.7
style 7.4
pose 7.2
color 7.2
sexy 7.2
office 7.2
hair 7.1
art 7

Google
created on 2019-06-01

Team 91.5
Standing 87.9
Crew 65.2
Uniform 62.5

Microsoft
created on 2019-06-01

person 97
posing 97
clothing 95.4
group 94.8
standing 91.4
sports uniform 89.1
footwear 78.2
baseball 75.7
hockey 68.8

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 52.1%
Angry 45.4%
Surprised 45.7%
Calm 46.4%
Sad 45.4%
Confused 45.5%
Disgusted 45.3%
Happy 51.2%

AWS Rekognition

Age 15-25
Gender Female, 53.2%
Confused 46.5%
Surprised 45.8%
Calm 47.7%
Sad 47.4%
Happy 45.5%
Disgusted 45.8%
Angry 46.3%

AWS Rekognition

Age 26-43
Gender Male, 54%
Angry 45.2%
Confused 45.3%
Surprised 45.3%
Happy 45.3%
Sad 50.8%
Calm 48%
Disgusted 45.1%

AWS Rekognition

Age 17-27
Gender Female, 54.5%
Confused 45.2%
Disgusted 45%
Calm 53.8%
Angry 45.1%
Sad 45.4%
Happy 45.3%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54%
Confused 45.4%
Calm 50.3%
Sad 47.4%
Surprised 45.4%
Angry 45.3%
Disgusted 45.3%
Happy 46%

AWS Rekognition

Age 26-43
Gender Male, 51%
Confused 45.9%
Happy 45.6%
Surprised 45.9%
Angry 45.6%
Disgusted 45.3%
Calm 48.1%
Sad 48.6%

AWS Rekognition

Age 20-38
Gender Female, 51%
Disgusted 45.2%
Calm 45.4%
Angry 45.3%
Sad 46.2%
Surprised 45.3%
Happy 52.1%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Male, 52.4%
Surprised 45.8%
Confused 46.5%
Disgusted 45.4%
Happy 47%
Sad 47.3%
Calm 47%
Angry 45.9%

AWS Rekognition

Age 23-38
Gender Female, 54.9%
Angry 45.2%
Calm 47.9%
Sad 50.2%
Surprised 45.2%
Disgusted 45.2%
Happy 45.8%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Disgusted 45.6%
Sad 46.6%
Calm 49.4%
Confused 45.7%
Surprised 45.6%
Happy 46.6%
Angry 45.5%

AWS Rekognition

Age 16-27
Gender Female, 52.9%
Angry 45.9%
Sad 46.1%
Happy 46.9%
Confused 45.8%
Surprised 46.1%
Calm 48.1%
Disgusted 46.1%

AWS Rekognition

Age 20-38
Gender Male, 52.7%
Disgusted 45.3%
Calm 50.3%
Sad 46.1%
Confused 45.8%
Angry 45.5%
Surprised 45.7%
Happy 46.3%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Sad 53.7%
Happy 45.5%
Confused 45.2%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%
Calm 45.3%

AWS Rekognition

Age 16-27
Gender Male, 54.2%
Disgusted 45.3%
Sad 46%
Happy 45.2%
Confused 45.5%
Surprised 45.3%
Angry 45.6%
Calm 52%

AWS Rekognition

Age 19-36
Gender Female, 51.6%
Happy 48.5%
Surprised 45.4%
Angry 45.5%
Confused 45.5%
Calm 47%
Sad 47.7%
Disgusted 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54%
Disgusted 45.1%
Calm 51.6%
Angry 45.2%
Sad 47.2%
Surprised 45.2%
Happy 45.5%
Confused 45.2%

AWS Rekognition

Age 17-27
Gender Male, 53.9%
Angry 45.8%
Happy 45.5%
Calm 49.4%
Surprised 45.4%
Sad 47.8%
Confused 45.5%
Disgusted 45.5%

Feature analysis

Amazon

Person 99%
Shoe 98.9%
Helmet 92.1%

Captions

Microsoft

a group of people posing for a photo 95.7%
a group of people posing for the camera 95.6%
a group of people posing for a picture 95.5%

Text analysis

Amazon

Bo