Human Generated Data

Title

Untitled (children at drugstore counter holding snakes, Sarasota)

Date

1944

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8677

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children at drugstore counter holding snakes, Sarasota)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1944

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 98.8
Person 98.8
Building 97.9
Person 96.9
Factory 96.1
Person 94.8
Person 93
Person 92.4
Person 92.1
Person 89.3
Person 88.5
Person 73
Assembly Line 72.2
Sunglasses 67.9
Accessories 67.9
Accessory 67.9
People 65.7
Person 64.7
Person 63.9
Crowd 62
Workshop 59.9
Manufacturing 59.4
Cafeteria 59.4
Restaurant 59.4
Sunglasses 58.2
Lab 58.2
Housing 55.6
Person 43.4

Imagga
created on 2022-01-09

classroom 34.3
people 32.9
man 30.3
male 29
room 28.3
person 26.5
table 23.4
adult 23.3
women 22.9
group 22.5
business 22.4
businessman 21.2
meeting 19.8
sitting 19.7
teacher 19.6
happy 19.4
team 18.8
men 18
indoors 17.6
smiling 17.3
businesswoman 17.3
marimba 16.5
percussion instrument 16.1
work 15.8
worker 15.3
lifestyle 15.2
home 15.1
office 15
desk 14.3
musical instrument 14.1
together 14
teamwork 13.9
education 13.8
working 13.2
executive 13.1
portrait 12.9
school 12.7
holding 12.4
senior 12.2
professional 12.1
modern 11.9
hall 11.7
30s 11.5
job 11.5
talking 11.4
businesspeople 11.4
learning 11.3
corporate 11.2
laptop 10.9
interior 10.6
supporter 10.6
couple 10.4
computer 10.4
student 10.2
indoor 10
children 10
smile 10
suit 9.9
restaurant 9.8
teaching 9.7
colleagues 9.7
class 9.6
casual 9.3
study 9.3
mature 9.3
house 9.2
cheerful 8.9
family 8.9
discussing 8.8
40s 8.8
discussion 8.8
boy 8.7
studying 8.6
elderly 8.6
chair 8.5
two 8.5
friends 8.4
manager 8.4
color 8.3
educator 8.2
to 8
spectator 7.9
explaining 7.9
four 7.7
old 7.7
drinking 7.6
enjoying 7.6
horizontal 7.5
city 7.5
planner 7.4
20s 7.3
playing 7.3
kid 7.1
clothing 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.7
window 98.4
text 93.9
people 76.7
group 72.6
clothing 68.8

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 85%
Calm 94.4%
Sad 4.3%
Happy 0.4%
Confused 0.3%
Angry 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 13-21
Gender Male, 96.6%
Calm 99.9%
Sad 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 58.3%
Calm 81.5%
Sad 15.8%
Confused 0.6%
Disgusted 0.6%
Happy 0.5%
Angry 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 79.2%
Calm 99.1%
Sad 0.5%
Confused 0.2%
Surprised 0.1%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 98.8%
Calm 97.7%
Surprised 2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Sunglasses 67.9%

Captions

Microsoft

a group of people standing next to a window 93.8%
a group of people standing in front of a window 93.1%
a group of people posing for a photo in front of a window 91%

Text analysis

Amazon

SIESTA
KEY,
SARASOTA,
J.
STEINMETZ,
23479. J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLAS
FLAS
23479.
KODOK-SVEEIX

Google

2347 STEINMETZ, SIESTA KEY, SARASOTA, FLA: KODVR-
KODVR-
SIESTA
STEINMETZ,
2347
KEY,
SARASOTA,
FLA: