Human Generated Data

Title

Untitled (Heinz employees serving samples in front of Heinz display)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8373
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Heinz employees serving samples in front of Heinz display)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.8
Human 99.8
Person 99.7
Person 99.5
Person 99.3
Person 99.1
Person 99.1
Clothing 92.9
Apparel 92.9
Person 92.3
Sailor Suit 85.3
Face 84.1
Person 83.2
Shirt 73.8
People 71.5
Indoors 70.9
Crowd 70.8
Word 59.4
Sleeve 57.5
Room 56
Shorts 55.6
Suit 55.3
Coat 55.3
Overcoat 55.3

Imagga
created on 2022-01-09

hat 36
man 30.9
male 27.7
megaphone 25.9
person 25.7
acoustic device 22.8
athlete 22.6
people 21.7
adult 20.7
player 20.6
ballplayer 19.1
device 19.1
sport 16.3
clothing 15.8
portrait 15.5
cowboy hat 15.1
men 14.6
happy 13.8
guy 13.2
standing 13
lifestyle 13
hand 12.9
outdoors 12.7
headdress 12.5
leisure 12.4
uniform 12.4
couple 12.2
contestant 12
two 11.8
sky 11.5
active 11.4
worker 11
boy 10.4
work 10.2
playing 10
fitness 9.9
job 9.7
businessman 9.7
ball 9.7
day 9.4
construction 9.4
action 9.4
outdoor 9.2
attractive 9.1
industrial 9.1
old 9
summer 9
history 8.9
game 8.9
handsome 8.9
building 8.7
outside 8.5
model 8.5
horse 8.5
business 8.5
professional 8.4
brass 8.4
competition 8.2
friendly 8.2
healthy 8.2
style 8.2
equipment 8
looking 8
look 7.9
smile 7.8
face 7.8
black 7.8
architecture 7.8
play 7.7
travel 7.7
fight 7.7
helmet 7.7
industry 7.7
serious 7.6
fashion 7.5
senior 7.5
fun 7.5
mature 7.4
covering 7.3
exercise 7.3
cowboy 7.2
happiness 7
together 7
builder 7

Google
created on 2022-01-09

Hat 87.2
Standing 86.4
Gesture 85.3
Style 83.9
Black-and-white 83.8
Font 80
Monochrome 74.8
Crowd 74.4
Crew 73.3
Sports uniform 72.9
Monochrome photography 72
Team 71.9
Cap 71.2
Player 70.5
T-shirt 68.3
Sports 67.8
Uniform 64.3
Bat-and-ball games 63.8
Stadium 61.2
Team sport 60.5

Microsoft
created on 2022-01-09

person 99.8
text 98.3
clothing 93.5
man 83.1
standing 76.7
black and white 57.3

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 93.7%
Happy 3.6%
Surprised 1%
Sad 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people standing on a court 93.6%
a group of people standing on the court 93.4%
a group of people on a court 93.3%

Text analysis

Amazon

17268
17268.
adidas
TOMAIO
NAOOX
RM
NAOOX YT37ABL
YT37ABL

Google

268. 7268.
268.
7268.