Human Generated Data

Title

Untitled (man and woman in riding outfits seated on a bench indoors)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5181
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman in riding outfits seated on a bench indoors)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.3
Human 98.3
Tie 98
Accessories 98
Accessory 98
Person 97.4
Clothing 83.3
Apparel 83.3
Clinic 64
People 62.3
Text 59.3
Photography 55.6
Photo 55.6

Imagga
created on 2022-01-23

bow tie 90
necktie 74.6
garment 47.3
man 43.7
lab coat 36.8
person 36.5
coat 36.2
businessman 34.4
male 33.4
people 32.4
professional 31.8
work 29.8
office 29.7
clothing 29.7
business 29.2
medical 29.1
adult 28.5
doctor 26.3
worker 24
businesspeople 22.8
laboratory 22.2
computer 21.6
working 21.2
medicine 21.1
laptop 21
lab 20.4
job 20.4
occupation 20.2
looking 20
team 19.7
portrait 19.4
indoors 19.3
corporate 18.9
desk 18.9
teamwork 18.5
student 18.3
businesswoman 18.2
health 18.1
science 17.8
scientist 17.6
smiling 17.4
research 17.1
happy 16.9
chemical 16.5
face 16.3
biology 16.1
education 15.6
hospital 15.5
test 15.4
table 14.7
indoor 14.6
sitting 14.6
men 14.6
group 14.5
chemistry 14.5
handsome 14.3
colleagues 13.6
clinic 13.4
chemist 12.8
scientific 12.6
serious 12.4
meeting 12.3
bright 12.2
technology 11.9
casual 11.9
confident 11.8
experiment 11.7
expertise 11.7
care 11.5
shirt 11.2
suit 11.1
room 10.9
color 10.6
executive 10.4
home 10.4
women 10.3
patient 10.1
hand 9.9
microscope 9.9
biotechnology 9.8
equipment 9.8
human 9.8
thoughtful 9.7
practitioner 9.7
corporation 9.7
elderly 9.6
workplace 9.5
talking 9.5
one person 9.4
senior 9.4
study 9.3
glasses 9.3
attractive 9.1
researcher 8.9
success 8.9
analysis 8.8
discovery 8.8
look 8.8
assistant 8.7
uniform 8.7
tube 8.7
lifestyle 8.7
development 8.6
smile 8.6
tie 8.5
horizontal 8.4
mature 8.4
camera 8.3
successful 8.2
alone 8.2
cheerful 8.1
nurse 8.1
microbiology 7.9
associates 7.9
discussing 7.9
happiness 7.8
technician 7.8
conference 7.8
consultant 7.8
1 7.7
modern 7.7
think 7.7
two 7.6
sit 7.6
communication 7.6
instrument 7.5
manager 7.5
holding 7.4
focus 7.4
safety 7.4
20s 7.3
specialist 7.1
day 7.1
together 7

Google
created on 2022-01-23

Picture frame 94.5
Black-and-white 82.7
Snapshot 74.3
Monochrome 73.4
Monochrome photography 73.3
Service 72.8
Cooking 71.8
Event 69.8
Room 69.5
Vintage clothing 66.4
Curtain 65.6
Stock photography 64.3
Tie 64.2
Hat 62.5
Sitting 61.2
Uniform 60.4
History 56.9
Photo caption 52.4
Apron 50.4

Microsoft
created on 2022-01-23

text 99.6
wall 95.3
man 90.5
clothing 87.6
person 85.1
human face 83.3
black and white 68.4
posing 46.4

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 50.9%
Calm 37.7%
Sad 32.7%
Happy 20.7%
Surprised 6.5%
Angry 0.7%
Disgusted 0.6%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 95.1%
Calm 95.8%
Sad 2.6%
Angry 0.4%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Tie 98%

Captions

Microsoft

a group of men posing for a photo 73%
an old photo of a man 72.9%
a group of people posing for a photo 71%

Text analysis

Amazon

11526
NAGON
YTABAS

Google

)1526
)1526