Human Generated Data

Title

Untitled (woman writing letter to husband in service with son watching, Pennsylvania)
Date

1942, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.238
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman writing letter to husband in service with son watching, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Person 97.4
Officer 96.5
Military Uniform 96.5
Military 96.5
Hat 95.4
Clothing 95.4
Apparel 95.4
Person 92.1
Furniture 86.5
Face 76.4
Captain 71.9
Table 67.2
Portrait 63.1
Photography 63.1
Photo 63.1
Sailor Suit 60.4
Desk 58.1

Imagga
created on 2022-01-08

laptop 62.5
computer 60.9
office 57.9
business 46.8
desk 45
work 42.4
working 39.8
businessman 39.8
businesswoman 38.2
executive 35.3
corporate 34.4
professional 34.2
person 33.3
man 33
people 31.8
job 31
male 29.8
sitting 26.7
notebook 26.3
table 26.2
adult 25.6
looking 24.8
technology 24.5
smiling 23.9
happy 23.2
attractive 21.7
worker 21.4
businesspeople 20.9
communication 20.2
meeting 19.8
call 19.7
handsome 19.6
manager 18.6
confident 18.2
suit 18.2
workplace 18.1
career 18
home 17.6
smile 17.1
success 16.1
keyboard 16
lifestyle 15.2
portrait 14.9
modern 14.7
education 14.7
indoor 14.6
group 14.5
women 14.2
engineer 14.1
indoors 14.1
successful 13.7
team 13.5
telephone 13.1
teamwork 13
men 12.9
one 12.7
student 12.4
cheerful 12.2
phone 12
expression 12
occupation 11.9
scholar 11.8
employee 11.5
serious 11.5
face 11.4
company 11.2
room 11.2
casual 11
couch 10.6
corporation 10.6
monitor 10.6
contemporary 10.4
alone 10.1
businessperson 9.8
jacket 9.6
30s 9.6
stress 9.6
wireless 9.5
talking 9.5
thinking 9.5
college 9.5
tie 9.5
coffee 9.3
house 9.2
20s 9.2
pretty 9.1
screen 8.8
together 8.8
colleagues 8.8
intellectual 8.7
talk 8.6
paper 8.6
staff 8.6
pen 8.5
shirt 8.4
study 8.4
school 8.1
interior 8
chair 7.8
couple 7.8
happiness 7.8
conference 7.8
discussion 7.8
employment 7.7
busy 7.7
personal computer 7.7
boss 7.7
formal 7.6
two 7.6
portable computer 7.6
reading 7.6
hand 7.6
learn 7.6
smart 7.5
focus 7.4
glasses 7.4
friendly 7.3
secretary 7.3
cup 7.2
center 7

Google
created on 2022-01-08

Picture frame 94.2
Chair 86.1
Smile 85.9
Hat 84.2
Vintage clothing 73.7
Cap 72.9
Table 71.1
Monochrome 69.5
Sitting 67.9
Military person 67.8
Event 67.5
Room 67.4
Suit 63.9
Desk 63.6
Classic 61.1
Monochrome photography 60.5
Peaked cap 60.3
Toddler 59.3
Costume hat 56.8
Official 55.7

Microsoft
created on 2022-01-08

person 98.9
text 98.6
clothing 93.5
indoor 86.1
man 78.7
black 75.8
old 41.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 99.8%
Angry 56%
Sad 22.1%
Confused 8.1%
Calm 5%
Fear 3.6%
Disgusted 2.6%
Surprised 1.9%
Happy 0.7%

AWS Rekognition

Age 29-39
Gender Female, 99.9%
Sad 69.1%
Calm 30%
Angry 0.3%
Disgusted 0.3%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 37-45
Gender Male, 95.7%
Calm 99.7%
Sad 0.2%
Angry 0.1%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 95.4%

Captions

Microsoft

a person sitting on a table 86.1%
a person sitting at a table 86%
a person sitting at a desk 85.9%

Text analysis

Amazon

UOS
ALL