Human Generated Data

Title

Untitled (man with two women in front of Heinz chef display)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8374
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with two women in front of Heinz chef display)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.1
Human 99.1
Person 98.9
Person 98.7
Person 98.6
Clothing 79.7
Apparel 79.7
Crowd 76.8
Face 74.9
Performer 60.9
Glass 58.5
Finger 58.2
Text 58.1
Female 57.4
Suit 57.4
Coat 57.4
Overcoat 57.4

Imagga
created on 2022-01-09

man 39
businessman 37.9
business 35.2
male 29.8
person 27.6
adult 25.3
people 22.3
office 21.2
work 19.9
team 17.9
professional 17.7
book jacket 17
success 16.9
happy 16.3
jacket 16.2
job 15.9
manager 15.8
suit 15.6
portrait 15.5
corporate 15.5
executive 14.1
teacher 13.3
education 13
smile 12.8
building 12.8
worker 12.7
technology 12.6
black 12.1
men 12
student 11.4
businesspeople 11.4
blackboard 11.3
desk 11.3
meeting 11.3
handsome 10.7
idea 10.7
hat 10.7
face 10.6
looking 10.4
casual 10.2
wrapping 10.1
laptop 10
businesswoman 10
employee 9.9
human 9.7
group 9.7
sitting 9.4
expression 9.4
money 9.4
two 9.3
finance 9.3
engineer 9.2
occupation 9.2
indoor 9.1
modern 9.1
covering 8.8
staff 8.6
serious 8.6
thinking 8.5
world 8.4
senior 8.4
metropolitan 8.4
company 8.4
old 8.4
successful 8.2
confident 8.2
currency 8.1
computer 8
smiling 8
happiness 7.8
color 7.8
gong 7.7
room 7.6
chart 7.6
engineering 7.6
solution 7.6
career 7.6
one 7.5
dollar 7.4
teamwork 7.4
positive 7.4
lady 7.3
financial 7.1
science 7.1
builder 7.1
working 7.1
day 7.1
indoors 7

Google
created on 2022-01-09

Clothing 98.7
Shirt 93.8
Hat 92
Idiophone 91.4
Black 89.8
Fedora 89.5
Sun hat 85.7
Black-and-white 85.2
Musical instrument 85
Style 84.1
Font 82.5
Music 80.5
Musician 79.3
Entertainment 78
Monochrome 77.7
Monochrome photography 76.9
T-shirt 76.8
Audio equipment 76.3
Snapshot 74.3
Event 73.8

Microsoft
created on 2022-01-09

text 99
musical instrument 90.8
clothing 87
person 86
man 73.1
poster 73
guitar 71.9
black and white 65.3
concert 55.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 86.7%
Happy 96.9%
Surprised 1.1%
Calm 0.6%
Confused 0.4%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%
Sad 0.2%

AWS Rekognition

Age 50-58
Gender Male, 98.8%
Happy 96.8%
Calm 1.7%
Surprised 0.6%
Sad 0.4%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 98.4%
Surprised 65.4%
Calm 29.4%
Confused 1.8%
Disgusted 1.1%
Happy 0.9%
Sad 0.7%
Angry 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 70.1%
a group of people standing in front of a mirror posing for the camera 66.6%
a man and woman standing in front of a mirror posing for the camera 49%

Text analysis

Amazon

HEINZ
17294
19294.
MAGON

Google

7294 HEINZ 11294.
7294
HEINZ
11294.