Human Generated Data

Title

Untitled (seated boxer surrounded by men in suits, New York City)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12130

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated boxer surrounded by men in suits, New York City)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Person 98.9
Apparel 98.3
Clothing 98.3
Person 97.2
Person 97.2
Female 87
Accessories 74.7
Accessory 74.7
Tie 74.7
Woman 72
People 69.8
Face 69.3
Girl 61
Finger 58.5
Portrait 57.2
Photography 57.2
Photo 57.2
Blonde 55.6
Kid 55.6
Teen 55.6
Child 55.6

Imagga
created on 2022-01-22

patient 95.8
person 77.6
nurse 76.1
case 67.4
sick person 66.8
man 39
male 34
people 33.5
adult 28.7
sitting 25.8
indoors 25.5
professional 24.5
senior 24.4
office 23.3
computer 22.4
home 22.3
happy 21.3
medical 20.3
work 18.8
working 18.6
laptop 18.2
lifestyle 18.1
doctor 17.9
job 17.7
business 17.6
smiling 17.4
men 17.2
specialist 16.9
portrait 16.8
health 16.7
desk 16.1
worker 16
businessman 15.9
women 15.8
couple 15.7
indoor 15.5
elderly 15.3
team 15.2
mature 14.9
holding 14.9
hospital 14.7
cheerful 14.6
casual 14.4
looking 14.4
clothing 14
education 13.9
occupation 13.7
mid adult 13.5
meeting 13.2
table 13
color 12.8
face 12.8
room 11.8
happiness 11.8
handsome 11.6
care 11.5
smile 11.4
together 11.4
old 11.1
technology 11.1
teamwork 11.1
communication 10.9
clinic 10.9
30s 10.6
medicine 10.6
retirement 10.6
illness 10.5
two 10.2
teacher 10
coat 9.9
group 9.7
talking 9.5
day 9.4
horizontal 9.2
suit 9
50s 8.8
two people 8.8
class 8.7
husband 8.6
workplace 8.6
businesspeople 8.5
surgeon 8.5
modern 8.4
notebook 8.4
inside 8.3
human 8.2
to 8
bright 7.9
60s 7.8
teaching 7.8
discussion 7.8
monitor 7.8
older 7.8
classroom 7.8
retired 7.8
corporate 7.7
executive 7.7
adults 7.6
house 7.5
keyboard 7.5
manager 7.4
phone 7.4
treatment 7.3
equipment 7.2
interior 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 98.7
text 98.1
clothing 93.9
man 81.6
black and white 71.8
woman 54.3
preparing 50.5

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 99.8%
Sad 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 89%
Calm 92.1%
Happy 2.1%
Surprised 2%
Sad 1.5%
Angry 1%
Disgusted 0.4%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 54-64
Gender Male, 96.8%
Calm 99.9%
Sad 0%
Surprised 0%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 85.3%
Sad 10.8%
Confused 1.7%
Surprised 0.7%
Disgusted 0.4%
Fear 0.4%
Happy 0.3%
Angry 0.3%

AWS Rekognition

Age 45-51
Gender Male, 100%
Surprised 82.5%
Calm 9.3%
Sad 3.1%
Confused 1.8%
Fear 1.7%
Happy 0.6%
Disgusted 0.6%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 74.7%

Captions

Microsoft

a group of people standing in front of a window 87.4%
a group of people sitting at a table 87.3%
a group of people in front of a window 87%

Text analysis

Amazon

10713.
PF
CVCCENV

Google

10713.
10713. 10713.