Human Generated Data

Title

Untitled (woman and men walking up stairs with American flag)
Date

1936
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4760
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman and men walking up stairs with American flag)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4760

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.3
Apparel 99.3
Person 97.2
Human 97.2
Person 95.8
Person 94.7
Tie 93.9
Accessories 93.9
Accessory 93.9
Person 89.1
Sleeve 81.3
Coat 72.3
Overcoat 66.8
Suit 66.1
Face 62.8
People 61.1
Female 61.1
Photography 59.1
Photo 59.1
Clinic 57
Girl 55.5

Clarifai
created on 2023-10-27

people 99
man 98.6
adult 97.8
science 97.7
healthcare 94.5
research 93.7
doctor 93.5
monochrome 93.5
medicine 92.8
technology 92
scientist 90.7
business 88
wear 86.6
veil 86.4
uniform 86.1
group 85.8
coat 84.9
two 84.7
hospital 84.1
one 84

Imagga
created on 2022-01-29

nurse 65.2
lab coat 64.4
coat 60
people 33.5
person 32.7
medical 31.8
doctor 30.1
clothing 29.4
professional 28.4
patient 28.2
negative 26.4
man 26.2
adult 26.2
garment 24.7
male 22.7
health 22.2
medicine 22
film 21.8
business 21.3
hospital 20.5
businessman 20.3
clinic 20.3
laboratory 20.3
lab 19.4
team 18.8
research 18.1
worker 17.8
work 17.3
corporate 17.2
job 16.8
scientist 16.7
men 16.3
biology 16.1
photographic paper 16.1
science 16
human 15.7
happy 15.7
care 15.6
portrait 15.5
case 15.5
test 15.4
working 15
day 14.1
sick person 13.6
student 13.6
chemical 13.6
chemistry 13.5
teamwork 13
group 12.9
bright 12.9
office 12.8
20s 12.8
businesswoman 12.7
technology 12.6
scientific 12.6
indoors 12.3
clothes 12.2
education 12.1
attractive 11.9
women 11.9
assistant 11.7
smiling 11.6
smile 11.4
casual 11
chemist 10.8
suit 10.8
photographic equipment 10.7
physician 10.7
adults 10.4
face 9.9
colleagues 9.7
black 9.6
looking 9.6
blurred 9.6
development 9.5
businesspeople 9.5
happiness 9.4
instrument 9.3
blur 9.3
equipment 9.2
occupation 9.2
window 9.2
hand 9.1
success 8.8
biotechnology 8.8
businessmen 8.8
40s 8.8
optical 8.7
expertise 8.7
full length 8.7
corporation 8.7
daytime 8.7
profession 8.6
focus 8.3
lifestyle 7.9
building 7.9
microscope 7.9
microbiology 7.9
forties 7.8
days 7.8
couple 7.8
technician 7.8
standing 7.8
uniform 7.8
color 7.8
exam 7.7
illness 7.6
two 7.6
ethnic 7.6
commerce 7.5
cheerful 7.3
indoor 7.3
computer 7.2
home 7.2
modern 7

Google
created on 2022-01-29

Outerwear 95.4
Coat 89.4
Sleeve 87.2
Hat 86.8
Gesture 85.3
Style 83.8
Black-and-white 82.7
Collar 81.8
Blazer 78.2
Font 77
Suit 76.7
Formal wear 75.4
Monochrome photography 74.1
Smile 73.4
Monochrome 71.1
Fish 69
Vintage clothing 68.7
Event 67.7
Uniform 66.2
Stock photography 62.8

Microsoft
created on 2022-01-29

text 99.9
black and white 87.9
sketch 79.9
drawing 79.7
clothing 73.5
person 65
man 55.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98%
Surprised 99.4%
Fear 0.2%
Calm 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Happy 0%
Sad 0%

AWS Rekognition

Age 38-46
Gender Male, 97.7%
Fear 75.6%
Sad 18.8%
Confused 2.1%
Happy 0.9%
Surprised 0.8%
Angry 0.8%
Disgusted 0.6%
Calm 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 97.2%
Person 95.8%
Person 94.7%
Person 89.1%
Tie 93.9%
Suit 66.1%

Categories

Imagga

paintings art 92%
interior objects 7.6%

Captions

Microsoft
created on 2022-01-29

a man standing next to a window 47%
a man standing in front of a window 46.9%
a man posing for a photo 46.8%

Text analysis

Amazon

oh
.os
is
TEL
atternal

Google

ちと 231o丁る
ちと
231o
丁る