Human Generated Data

Title

Untitled ("Drink Pepsi-Cola" cooler and crowd)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4528

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled ("Drink Pepsi-Cola" cooler and crowd)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.6
Audience 99.4
Crowd 99.4
Person 99.2
Person 99.2
Person 98.2
Person 98
Person 97.8
Person 96.6
Indoors 95
Interior Design 93.4
Room 93.1
Classroom 90.5
School 90.5
Person 90.2
Person 88.3
Person 85.8
People 81.9
Lecture 81.3
Speech 81.3
Person 78
Person 77.1
Person 74.9
Seminar 72.5
Sitting 71.5
Meeting Room 65
Conference Room 65
Apparel 64.8
Clothing 64.8
Person 63.9
Person 61.3
Person 60.6
Photo 60.6
Face 60.6
Portrait 60.6
Photography 60.6
Press Conference 55.5
Overcoat 55.2
Suit 55.2
Coat 55.2

Imagga
created on 2022-01-23

man 36.9
senior 36.5
people 32.3
person 28.1
couple 26.1
elderly 25.8
nurse 25.4
adult 23.9
male 23.4
mature 22.3
smiling 21
home 20.7
happy 20.7
indoors 20.2
barbershop 20.1
old 18.8
patient 17.2
sitting 17.2
shop 16.9
together 16.6
retired 16.5
retirement 16.3
men 16.3
room 15.6
looking 15.2
portrait 14.9
lifestyle 14.4
teacher 14.3
mercantile establishment 13.6
women 13.4
love 13.4
medical 13.2
education 13
businessman 12.3
hospital 12.3
professional 11.7
business 11.5
husband 11.4
wife 11.4
health 11.1
camera 11.1
happiness 11
worker 10.9
casual clothing 10.8
smile 10.7
case 10.7
married 10.5
office 10.5
enjoying 10.4
meeting 10.4
clothing 10.2
casual 10.2
holding 9.9
hand 9.9
70s 9.8
grandfather 9.8
60s 9.8
cheerful 9.7
group 9.7
classroom 9.6
illness 9.5
hair 9.5
talking 9.5
marriage 9.5
togetherness 9.4
clinic 9.4
day 9.4
doctor 9.4
two 9.3
pensioner 9.2
communication 9.2
kin 9.2
horizontal 9.2
place of business 9.2
occupation 9.2
care 9
handsome 8.9
color 8.9
seniors 8.8
working 8.8
discussion 8.8
40s 8.8
two people 8.7
older 8.7
table 8.6
work 8.6
age 8.6
friends 8.4
aged 8.1
team 8.1
romantic 8
family 8
to 8
discussing 7.9
face 7.8
middle aged 7.8
life 7.8
educator 7.8
affection 7.7
pretty 7.7
desk 7.6
human 7.5
cap 7.4
teamwork 7.4
indoor 7.3
lady 7.3
gray 7.2
computer 7.2
shower cap 7.2
romance 7.1
grandma 7.1

Google
created on 2022-01-23

Photograph 94.1
Black-and-white 83
Hat 81.4
Window 80.7
Font 78.5
People 78.3
T-shirt 75.2
Monochrome photography 73
Monochrome 72.7
Event 72.7
Crowd 69.4
Team 67.8
Room 67.6
Cap 62.6
History 62.4
Illustration 62.3
Stock photography 62.1
Photo caption 60.9
Art 60.4
Vintage clothing 55.6

Microsoft
created on 2022-01-23

person 99.6
text 94.5
clothing 90.1
human face 77.6
group 77.1
man 73.6
people 66.5
crowd 3.8

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Sad 36.9%
Calm 29%
Happy 12.1%
Surprised 7.3%
Confused 6.7%
Angry 3.1%
Disgusted 2.8%
Fear 2.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Sad 44.8%
Surprised 30%
Happy 8.1%
Confused 6.7%
Calm 4.6%
Angry 3.2%
Disgusted 1.5%
Fear 1.1%

AWS Rekognition

Age 28-38
Gender Male, 94%
Calm 98.6%
Sad 0.7%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Surprised 0%

AWS Rekognition

Age 40-48
Gender Male, 91.9%
Sad 99%
Calm 0.8%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%
Happy 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people around each other 93.1%
a group of people in a room 93%
a group of people 92.9%

Text analysis

Amazon

DRINK
9
13541.
YT33A2
AHOX YT33A2
AHOX
PEPSITIC

Google

DRINK
13541. DRINK DRINK 13541.
13541.