Human Generated Data

Title

Untitled (shoe salesman helping a young girl try on shoes)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11958
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (shoe salesman helping a young girl try on shoes)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 96.6
Human 96.6
Person 96.2
Clinic 83.9
Clothing 76
Apparel 76
Shoe 69.5
Footwear 69.5
Female 69.2
Hospital 66.5
Coat 62.6
Furniture 56.3

Imagga
created on 2022-01-15

newspaper 100
product 100
creation 83.3
people 40.8
man 37
office 36.7
male 32.7
work 29.8
person 29.7
working 28.3
business 27.4
computer 26.5
businessman 25.6
professional 24.9
adult 24.1
indoors 23.7
team 23.3
desk 22.5
laptop 21
businesspeople 20.9
job 20.4
businesswoman 18.2
corporate 18.1
worker 17.9
medical 17.7
technology 17.1
indoor 16.4
sitting 16.3
table 16.1
room 15.7
men 15.5
doctor 15.1
manager 14.9
teamwork 14.8
group 14.5
happy 14.4
hospital 14.2
occupation 13.8
portrait 13.6
home 13.6
patient 13.5
meeting 13.2
daily 13.1
executive 12.9
paper 12.9
smile 12.8
20s 12.8
successful 12.8
looking 12.8
casual 12.7
colleagues 12.6
laboratory 12.5
health 12.5
smiling 12.3
student 11.8
color 11.7
paperwork 11.7
clinic 11.5
exam 11.5
medicine 11.5
writing 11.3
learning 11.3
keyboard 11.3
success 11.3
lifestyle 10.8
lab 10.7
face 10.7
together 10.5
talking 10.5
plan 10.4
education 10.4
document 10.2
day 10.2
workplace 9.5
reading 9.5
sit 9.5
senior 9.4
notebook 9.3
bright 9.3
communication 9.2
hand 9.1
holding 9.1
one 9
cheerful 8.9
busy 8.7
30s 8.7
studying 8.6
illness 8.6
research 8.6
pen 8.5
coat 8.4
camera 8.3
clothing 8.3
care 8.2
alone 8.2
negative 8
women 7.9
scientist 7.8
60s 7.8
calculator 7.8
homework 7.8
jacket 7.8
assistant 7.8
check 7.7
books 7.7
test 7.7
pencil 7.6
college 7.6
career 7.6
horizontal 7.5
human 7.5
teenager 7.3
suit 7.2
school 7.2
science 7.1
nurse 7
attractive 7

Google
created on 2022-01-15

Black-and-white 83.8
Font 74.4
Machine 73.3
Monochrome 72
Monochrome photography 71.8
Art 70.2
Engineering 67.7
Science 65.7
Room 64.8
Stock photography 62.5
Job 60.6
Handwriting 60.4
Paper 57.4
Employment 57.1
Photographic paper 56.2
Sitting 53.8
Advertising 53.5
Illustration 53
Visual arts 52.3
Photography 51.6

Microsoft
created on 2022-01-15

text 99.6
man 94.4
person 93.1
newspaper 93
window 80.5
black and white 76
clothing 72.6
drawing 53.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.2%
Calm 96.8%
Surprised 1.7%
Happy 0.8%
Sad 0.2%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 66.3%
Calm 96%
Confused 2.4%
Sad 0.9%
Angry 0.3%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Shoe 69.5%

Captions

Microsoft

a man standing in front of a window 43.6%
a man sitting on a newspaper 25.9%
a man standing in front of a newspaper 25.8%

Text analysis

Amazon

5296
YT33A2
32AB YT33A2
32AB

Google

5296
5296