Human Generated Data

Title

Untitled (Duke University graduate with parents)

Date

1959

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10462

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Duke University graduate with parents)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.5
Person 99.5
Person 99
Apparel 98.4
Clothing 98.4
Person 98.4
Person 97.4
Person 97.4
Person 96
Tie 94.4
Accessories 94.4
Accessory 94.4
Person 92.8
Person 84.3
Overcoat 74
Coat 74
People 73.7
Architecture 70
Building 70
Shorts 65.9
Face 63.4
Portrait 63.4
Photography 63.4
Photo 63.4
Person 62.4
Person 62.1
Suit 61.7
Female 60.5
Sailor Suit 58.8
Priest 57.8
Military Uniform 55.9
Officer 55.9
Military 55.9
Costume 55.7

Imagga
created on 2022-01-09

groom 28.9
people 21.8
person 20.8
statue 20.2
male 20
man 18.8
couple 18.3
clothing 17.1
monument 16.8
architecture 16.4
bride 16.3
adult 15.8
love 15.8
portrait 15.5
waiter 15.4
catholic 15.2
church 14.8
old 14.6
history 14.3
happiness 14.1
tourism 14
wedding 13.8
religion 13.4
building 13
marble 12.6
sculpture 12.5
family 12.5
dining-room attendant 12.4
travel 12
happy 11.9
two 11.9
dress 11.7
smiling 11.6
men 11.2
historic 11
day 11
landmark 10.8
city 10.8
married 10.5
tourist 10.4
worker 10
face 9.9
employee 9.9
park 9.9
business 9.7
stone 9.7
faith 9.6
religious 9.4
gown 9.4
outdoors 9
businessman 8.8
ceremony 8.7
mother 8.7
women 8.7
culture 8.5
art 8.5
clothes 8.4
famous 8.4
cemetery 8.4
fashion 8.3
world 8.2
suit 8
together 7.9
smile 7.8
standing 7.8
ancient 7.8
life 7.8
youth 7.7
god 7.7
nurse 7.6
bouquet 7.5
memorial 7.5
historical 7.5
traditional 7.5
cheerful 7.3
garment 7.3
detail 7.2
celebration 7.2

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 96.4
black and white 91.2
funeral 72.9
person 69.5
clothing 65.9
posing 63.2
statue 59.3
man 57.2

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 62.9%
Calm 54.3%
Fear 15.4%
Sad 8.7%
Happy 7.1%
Confused 5.8%
Angry 3.7%
Surprised 3.3%
Disgusted 1.6%

AWS Rekognition

Age 45-53
Gender Male, 86.4%
Calm 45.8%
Happy 40.9%
Sad 3.9%
Confused 3.3%
Disgusted 2.5%
Angry 1.8%
Surprised 1.3%
Fear 0.4%

AWS Rekognition

Age 34-42
Gender Male, 91.3%
Sad 48.7%
Happy 39.5%
Surprised 3%
Fear 2.8%
Confused 1.9%
Disgusted 1.5%
Calm 1.3%
Angry 1.3%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Sad 79.4%
Fear 8.8%
Calm 3.7%
Disgusted 3%
Surprised 2.6%
Confused 1.8%
Angry 0.6%
Happy 0.2%

AWS Rekognition

Age 13-21
Gender Female, 82.4%
Calm 57.7%
Happy 27.8%
Sad 11.9%
Angry 0.8%
Fear 0.7%
Surprised 0.6%
Disgusted 0.3%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 94.4%

Captions

Microsoft

a group of people posing for a photo 87.7%
a man and a woman standing in front of a building 77.3%
a group of people standing in front of a building 77.2%

Text analysis

Amazon

44440

Google

O
4 4 4 Hb O
4
Hb