Human Generated Data

Title

Untitled (man seated in front of trailer home, Bradenton, Florida)
Date

1951, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man seated in front of trailer home, Bradenton, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1951, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 98.6
Person 98.6
Bird 94.5
Animal 94.5
Person 92.2
Clothing 73.9
Apparel 73.9
Helmet 73.9
Food 66.9
Meal 66.9
Sphere 60.1
Machine 57.4

Imagga
created on 2022-01-09

man 43.7
person 39.8
male 34.1
people 29
senior 26.2
adult 24.8
professional 24.6
lab coat 24.4
glasses 21.3
coat 21.2
office 20.9
mature 20.5
medical 20.3
elderly 20.1
smiling 19.5
happy 19.4
men 18.9
business 18.8
portrait 18.8
businessman 18.5
looking 17.6
patient 17.1
doctor 16.9
occupation 16.5
specialist 16.4
old 16
indoors 15.8
nurse 15.7
seller 15.6
job 15
smile 15
work 14.9
holding 14.9
home 14.4
worker 14.3
face 13.5
hospital 13.4
grandfather 12.8
happiness 12.5
camera 12
serious 11.4
human 11.2
computer 11.2
sitting 11.2
health 11.1
medicine 10.6
profession 10.5
couple 10.5
clinic 10.4
casual 10.2
lifestyle 10.1
stethoscope 10.1
laptop 10
care 9.9
cheerful 9.8
scholar 9.7
working 9.7
expertise 9.7
technology 9.6
laboratory 9.6
practitioner 9.4
student 9.1
kitchen 8.9
intellectual 8.8
test 8.7
retirement 8.6
exam 8.6
equipment 8.6
corporate 8.6
research 8.6
tie 8.5
biology 8.5
pharmacist 8.5
one person 8.5
modern 8.4
newspaper 8.2
aged 8.1
suit 8.1
handsome 8
garment 7.9
facing camera 7.9
scientist 7.8
standing 7.8
lab 7.8
clothing 7.7
husband 7.6
finance 7.6
wife 7.6
product 7.3
black 7.2
hair 7.1
science 7.1
microscope 7
look 7

Google
created on 2022-01-09

White 92.2
Window 84.6
Musical instrument 81
Plant 79.6
Motor vehicle 76
Monochrome 74
Tree 72.8
Monochrome photography 71.5
Cooking 65.8
Vintage clothing 63.3
Bird 62.8
Machine 60.9
Sitting 60.2
History 58.2
Folk instrument 57.1
Classic 54.6
Yard 51.6

Microsoft
created on 2022-01-09

person 98.6
text 98
outdoor 91.8
man 91.8
black and white 86.6
clothing 83.4
old 77.3
appliance 64.7
posing 42.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 65-75
Gender Male, 100%
Happy 71.5%
Calm 17.7%
Confused 8.6%
Sad 0.8%
Surprised 0.5%
Angry 0.3%
Fear 0.3%
Disgusted 0.3%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Bird 94.5%
Helmet 73.9%

Captions

Microsoft

an old photo of a man 84.7%
old photo of a man 82.3%
a man standing next to a building 75.7%

Text analysis

Amazon

1951
109
51%
210
Joe
Florida
Stu
Joe J. Steinmetz Stu
Bradenton, Florida
Steinmetz
J.
Bradenton,
WILSON
LIZZIE
MASS
BOSTON MASS
JOHN
BOSTON
JOHN & LIZZIE
&
16
L.76

Google

MASS
&
BOSTON
Joe
Steinmetz
Bradenton,
JOCN
WILSON
109
Stud
Florida
JOCN & LIZZE WILSON BOSTON MASS 109 51% Joe J. Steinmetz Stud Bradenton, Florida 1951 210
LIZZE
51%
J.
1951
210