Human Generated Data

Title

Untitled (man pouring a drink in front of fireplace with woman)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4536
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man pouring a drink in front of fireplace with woman)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.9
Human 98.9
Person 98.3
Clothing 97.3
Apparel 97.3
Sleeve 85.8
Advertisement 73.5
Poster 68.3
Long Sleeve 68.2
Photography 63
Photo 63
Collage 58.9
Suit 58.2
Coat 58.2
Overcoat 58.2
Pants 56.2
Female 55.7

Imagga
created on 2022-01-23

man 40.3
people 38.5
person 38.3
male 35.5
businessman 33.5
professional 33.5
team 29.6
business 29.2
work 29
job 25.7
teamwork 24.1
adult 23.4
teacher 22.6
office 21.4
worker 21.3
businesswoman 20.9
men 20.6
occupation 20.2
medical 18.5
working 17.7
boss 17.2
meeting 17
group 16.9
presentation 16.7
life 15.7
couple 15.7
corporate 15.5
leader 15.4
bright 15
audience 14.6
happy 14.4
crowd 14.4
human 14.2
room 14
educator 13.8
smiling 13.7
president 13.7
women 13.4
coat 13.3
nation 13.3
supporters 12.8
cheering 12.7
scientist 12.7
nighttime 12.7
speech 12.7
stadium 12.6
assistant 12.6
colleagues 12.6
chemistry 12.6
patriotic 12.5
research 12.4
medicine 12.3
vibrant 12.3
doctor 12.2
lights 12.1
flag 12
health 11.8
executive 11.8
instrument 11.8
lab 11.7
chemical 11.6
clothing 11.6
laboratory 11.6
development 11.4
biology 11.4
design 11.3
sexy 11.2
home 11.2
symbol 10.8
scientific 10.7
desk 10.6
indoors 10.5
modern 10.5
businesspeople 10.4
computer 10.4
education 10.4
sitting 10.3
icon 10.3
two 10.2
communication 10.1
laptop 10
clinic 10
silhouette 9.9
suit 9.9
profession 9.6
patient 9.5
vivid 9.3
portrait 9.1
microscope 8.9
information 8.9
looking 8.8
conference 8.8
analysis 8.8
equipment 8.5
manager 8.4
mature 8.4
student 8.3
baron 8.3
brass 8.2
technology 8.2
science 8
lab coat 8
interior 8
table 7.9
associates 7.9
day 7.8
smile 7.8
optical 7.8
test 7.7
casual 7.6
talking 7.6
indoor 7.3
new 7.3
board 7.2
handsome 7.1
idea 7.1
love 7.1
happiness 7.1
nurse 7
shop 7

Google
created on 2022-01-23

Photograph 94.2
Sleeve 87.1
Black-and-white 84.8
Style 83.9
Line 81.7
Snapshot 74.3
Monochrome photography 71.4
Monochrome 70.4
Event 69.4
Fashion design 67.5
Room 67.4
Display case 66.7
Art 63.9
Stock photography 62.9
Rectangle 58.6
Vintage clothing 55.6
Hat 54.6
Photography 52.2
History 50.9
Personal protective equipment 50.9

Microsoft
created on 2022-01-23

text 98.5
man 94.8
black and white 82.9
clothing 59.4
posing 51

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 55.4%
Calm 97.3%
Sad 1.7%
Confused 0.3%
Happy 0.2%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a man standing in front of a window 72.3%
a man standing in front of a window posing for the camera 60.3%
a man standing next to a window 60.2%

Text analysis

Amazon

11853.
11833.
SU

Google

1853. 1853. HAGOX-YTRRA2 -AAMTPA
1853.
HAGOX-YTRRA2
-AAMTPA