Human Generated Data

Title

Untitled ("Creamette" employee handing ice cream cone to girl through window)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5391

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled ("Creamette" employee handing ice cream cone to girl through window)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Door 99.1
Person 97.4
Folding Door 75
Sliding Door 68.8
Person 64.5
Clothing 58
Apparel 58

Imagga
created on 2022-01-23

man 37.6
male 24.1
people 23.4
person 22.7
case 19.9
adult 17.6
worker 17.5
job 16.8
work 16.5
men 16.3
professional 16.2
business 15.2
working 14.1
office 13.6
happy 13.2
occupation 12.8
home 12.8
indoors 12.3
portrait 12.3
lifestyle 12.3
smile 12.1
building 11.9
smiling 11.6
patient 11.3
medical 10.6
window 10.5
room 10.3
doctor 10.3
nurse 10.2
house 10
modern 9.8
health 9.7
looking 9.6
tool 9.4
two 9.3
passenger 9.3
hospital 9.1
women 8.7
skill 8.7
industry 8.5
equipment 8.5
casual 8.5
mature 8.4
life 8.2
healthy 8.2
cheerful 8.1
glass 8.1
interior 8
couple 7.8
happiness 7.8
standing 7.8
face 7.8
sitting 7.7
construction 7.7
pretty 7.7
repair 7.7
surgeon 7.5
human 7.5
senior 7.5
coat 7.4
suit 7.3
confident 7.3
industrial 7.3
metal 7.2
clothing 7.2
hair 7.1
science 7.1
door 7.1
businessman 7.1
medicine 7
together 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 90.6
person 87.3
black and white 83.8
clothing 81.2

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 91.6%
Sad 67.9%
Surprised 10.8%
Happy 8.7%
Calm 7.2%
Angry 2%
Confused 1.8%
Disgusted 0.9%
Fear 0.7%

AWS Rekognition

Age 41-49
Gender Female, 90.8%
Happy 50.5%
Confused 19.1%
Sad 14.2%
Calm 10.7%
Fear 1.8%
Surprised 1.4%
Angry 1.2%
Disgusted 1.1%

AWS Rekognition

Age 18-24
Gender Male, 90.8%
Sad 52.4%
Calm 23.8%
Fear 12.3%
Angry 5.8%
Confused 2%
Happy 1.8%
Disgusted 1%
Surprised 0.8%

AWS Rekognition

Age 34-42
Gender Female, 98.8%
Calm 93.7%
Sad 2.4%
Disgusted 1.3%
Happy 1.1%
Confused 0.7%
Angry 0.4%
Surprised 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person standing in front of a window 85%
a person standing in front of a window 81%
a person standing in front of a window 80.9%

Text analysis

Amazon

STEINMETZ,
STEINMETZ, SARASOTA, FLORIDA
FLORIDA
SARASOTA,
26929
Creamette
EVEETA

Google

SARASOTA,
26929.
26929. STEINMETZ, SARASOTA, FLORIDA
FLORIDA
STEINMETZ,