Human Generated Data

Title

Untitled (sports doctor examining arm of baseball player)

Date

c. 1945

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7280

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (sports doctor examining arm of baseball player)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.5
Person 99.5
Clothing 99.2
Apparel 99.2
Person 91.3
Shorts 88.2
Person 84.5
Building 80.7
Transportation 64.7
Face 64.4
Photography 62.8
Portrait 62.8
Photo 62.8
Vehicle 62.8
Female 62.4
Hat 59
Cap 58.6
Factory 58.6

Imagga
created on 2022-01-15

newspaper 37.1
shop 34.4
barbershop 31.9
product 28.6
people 27.3
man 26.2
mercantile establishment 23.8
male 22.7
creation 21.5
medical 20.3
men 19.7
work 19.6
person 19.6
professional 17.9
daily 17.7
business 17.6
worker 17.6
place of business 15.9
working 15
adult 15
medicine 14.1
doctor 13.2
hospital 12.6
indoors 12.3
health 11.8
team 11.6
businessman 11.5
patient 11.3
room 11.2
lab 10.7
nurse 10.6
job 10.6
laboratory 10.6
life 10.5
biology 10.4
technology 10.4
equipment 10.2
clothing 10.2
scientist 9.8
human 9.7
research 9.5
building 9.3
surgeon 9.3
waiter 9.3
restaurant 9.2
horizontal 9.2
occupation 9.2
city 9.1
surgery 8.8
urban 8.7
chemistry 8.7
test 8.7
mask 8.6
illness 8.6
industry 8.5
instrument 8.5
coat 8.5
cafeteria 8.4
black 8.4
portrait 8.4
old 8.4
employee 8.3
interior 8
women 7.9
establishment 7.9
modern 7.7
motion 7.7
profession 7.7
hand 7.6
dining-room attendant 7.4
care 7.4
uniform 7.1
architecture 7

Google
created on 2022-01-15

Shorts 94.4
Hat 92.3
Style 83.8
Black-and-white 83.8
T-shirt 79.6
Baseball cap 78.9
Cap 72.4
Monochrome photography 72.2
Monochrome 71.7
Stool 70.7
Machine 69.9
Table 69.1
Sitting 62.2
Cooking 60.4
Room 58.8
Automotive design 56.5
Sun hat 55
Motor vehicle 51.2
Advertising 50.4

Microsoft
created on 2022-01-15

text 99.6
clothing 92.6
man 90.5
person 88.8

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 97.9%
Calm 99%
Sad 0.5%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 54-64
Gender Male, 99.5%
Calm 100%
Surprised 0%
Sad 0%
Fear 0%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a man sitting in front of a window 62.6%
a man standing in front of a window 62.5%
a man sitting on a bus 25.3%

Text analysis

Amazon

FLORIDA
SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
STEINMETZ,
25672
Dodgers
KODVK-EVEETA

Google

Dodgers 25672 STEINMETZ, SARASOTA, FLORIDA YT37A2-
25672
YT37A2-
Dodgers
STEINMETZ,
SARASOTA,
FLORIDA