Human Generated Data

Title

Untitled (seated man holding tray containing image of the trailer in the background)
Date

1951
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4627
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated man holding tray containing image of the trailer in the background)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 98.3
Human 98.3
Chair 90
Furniture 90
Face 85.4
Apparel 75.7
Clothing 75.7
Shorts 68.3
Photography 63.7
Portrait 63.7
Photo 63.7
Sitting 55.5

Imagga
created on 2021-12-14

newspaper 52
negative 42.7
product 40.7
film 38.6
creation 33.3
man 31
male 27.7
people 27.3
business 27.3
person 27.1
photographic paper 26.1
businessman 23.8
work 22.1
professional 21.9
adult 21.1
office 21
looking 20
portrait 19.4
photographic equipment 17.4
job 15.9
medical 15.9
laptop 15.5
laboratory 15.4
team 15.2
worker 15.2
computer 14.4
technology 14.1
doctor 14.1
medicine 14.1
smiling 13.7
men 13.7
working 13.3
happy 12.5
health 12.5
manager 12.1
human 12
modern 11.9
smile 11.4
senior 11.2
corporate 11.2
teamwork 11.1
money 11.1
lifestyle 10.8
lab 10.7
science 10.7
face 10.7
serious 10.5
group 10.5
success 10.5
businesspeople 10.4
hospital 10.3
sitting 10.3
glasses 10.2
finance 10.1
occupation 10.1
successful 10.1
care 9.9
hand 9.9
indoors 9.7
test 9.6
education 9.5
women 9.5
plan 9.5
space 9.3
businesswoman 9.1
holding 9.1
old 9.1
currency 9
chemistry 8.7
project 8.7
model 8.6
room 8.4
mature 8.4
dollar 8.3
suit 8.2
student 8.2
financial 8
clinic 8
copy 8
table 8
desk 7.8
thoughtful 7.8
scientific 7.8
architect 7.7
construction 7.7
equipment 7.7
attractive 7.7
notes 7.7
chart 7.6
research 7.6
uniform 7.6
meeting 7.5
nurse 7.5
drawing 7.5
keyboard 7.5
company 7.4
building 7.4
cash 7.3
design 7.3
alone 7.3
new 7.3
bright 7.1
hair 7.1
day 7.1
paper 7.1
together 7

Google
created on 2021-12-14

Window 92.4
White 92.2
Black 89.6
Motor vehicle 85.3
Black-and-white 84.4
Style 84
Vehicle 78.5
Musical instrument 77.4
Kitchen appliance 77.3
Monochrome photography 77.1
Monochrome 76.9
Cooking 72
Sunglasses 71.3
Classic 66
Vintage clothing 65.2
Sitting 65
Automotive wheel system 63.4
Stock photography 62.8
Wind instrument 62.4
Musician 59.3

Microsoft
created on 2021-12-14

text 97.2
person 95.2
clothing 91.4
human face 82.6
man 79.4
smile 73.5
old 48

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Female, 80%
Sad 78.8%
Calm 15.5%
Confused 1.9%
Fear 1.2%
Surprised 1.1%
Happy 0.7%
Angry 0.6%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a group of people posing for a photo 69.9%
an old photo of a person 69.8%
a group of people posing for the camera 69.7%

Text analysis

Amazon

WILSON
LIZZIE
MASS
JOHN
BOSTON MASS
JOHN S LIZZIE
BOSTON
L.76
S

Google

MJ--YT33A2
JOMN
MJ--YT33A2 --A O JOMN &LIZZIE WILSON BOSTON MASS
&LIZZIE
MASS
O
--A
WILSON
BOSTON