Human Generated Data

Title

Untitled (women and men posing on steps with prominent figure in center)

Date

1938

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4286

Human Generated Data

Title

Untitled (women and men posing on steps with prominent figure in center)

People

Artist: Durette Studio, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.1
Human 99.1
Person 99
Person 98.8
Person 98.8
Clothing 96.8
Apparel 96.8
Person 96.7
Person 92.6
Sailor Suit 90.1
Person 78.5
Overcoat 76.5
Coat 76.5
Suit 76.5
Person 75.3
Female 69
People 65.3
Linen 64.6
Home Decor 64.6
Face 63
Photography 61.9
Photo 61.9
Portrait 61.9
Nurse 59.9
Girl 59
Dress 56.5

Clarifai
created on 2019-06-01

people 99.9
group 98.7
adult 98.6
man 97.2
group together 97
woman 96.8
wear 95.1
uniform 92.4
outfit 91
several 89.4
administration 88.3
leader 87
many 86.8
medical practitioner 86.7
five 86.7
indoors 79.8
room 78.4
four 77
facial expression 74.5
three 74.3

Imagga
created on 2019-06-01

man 31.2
person 30
male 28.6
people 27.9
adult 22.3
happy 21.9
couple 20.9
businessman 19.4
dancer 18.6
nurse 18.3
portrait 18.1
men 18
professional 17.9
business 16.4
performer 16.3
bride 16.1
group 16.1
two 16.1
happiness 15.7
groom 15.5
kin 15.2
family 15.1
teacher 15.1
smiling 14.5
smile 14.2
women 14.2
wedding 13.8
dress 13.5
together 13.1
corporate 12.9
love 12.6
entertainer 11.6
pretty 11.2
attractive 11.2
educator 10.8
lady 10.5
world 10.5
black 10.3
youth 10.2
mother 10.2
businesswoman 10
worker 10
silhouette 9.9
building 9.9
old 9.8
job 9.7
interior 9.7
home 9.6
celebration 9.6
boy 9.6
child 9.5
marriage 9.5
room 9.5
lifestyle 9.4
fashion 9
human 9
suit 9
office 8.8
indoors 8.8
clothing 8.8
career 8.5
historical 8.5
executive 8.4
elegance 8.4
window 8.4
indoor 8.2
girls 8.2
team 8.1
romantic 8
looking 8
day 7.8
husband 7.8
standing 7.8
face 7.8
partnership 7.7
boss 7.6
house 7.5
joy 7.5
traditional 7.5
fun 7.5
children 7.3
success 7.2
history 7.2
work 7.1
daughter 7
look 7

Google
created on 2019-06-01

Photograph 97.4
Snapshot 87
Standing 81.9
Room 65.7
Uniform 62.5
Photography 62.4
Family 57.7
Black-and-white 56.4
Team 52.3

Microsoft
created on 2019-06-01

window 95.6
clothing 94.8
posing 94.7
person 91.2
standing 88
smile 80.5
old 47

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Disgusted 49%
Confused 45.2%
Angry 47.2%
Calm 46.3%
Surprised 45.8%
Happy 45.6%
Sad 45.9%

AWS Rekognition

Age 60-80
Gender Female, 51.1%
Disgusted 45.3%
Calm 51%
Angry 45.5%
Sad 46.7%
Surprised 45.6%
Happy 45.5%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 51.3%
Sad 45.5%
Calm 52%
Surprised 45.7%
Angry 45.4%
Disgusted 45.2%
Happy 45.9%
Confused 45.3%

AWS Rekognition

Age 23-38
Gender Male, 51.6%
Happy 45.2%
Calm 46.9%
Angry 46.1%
Confused 45.5%
Surprised 45.8%
Sad 50.4%
Disgusted 45.2%

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people standing in front of a window posing for the camera 85.3%
a group of people posing for a photo in front of a window 85.2%
a group of people standing in front of a window posing for a photo 84%