Human Generated Data

Title

Untitled (man on sofa with cigarette, Huntington Valley, Pennsylvania)
Date

1940, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.257
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man on sofa with cigarette, Huntington Valley, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Furniture 100
Tie 97.8
Accessories 97.8
Accessory 97.8
Person 97.5
Human 97.5
Shelf 93
Bookcase 92.9
Living Room 86.8
Indoors 86.8
Room 86.8
Couch 69.4
Home Decor 61.1

Imagga
created on 2022-01-08

bow tie 55
groom 54.8
business 51.1
corporate 49.9
businessman 46.8
man 45.1
necktie 45
office 43.5
suit 43.5
businesswoman 41.8
professional 38.5
male 38.4
executive 36.8
people 34.6
bartender 33.9
businesspeople 33.2
person 30
work 29.9
happy 29.5
adult 28.5
garment 28.2
job 27.5
meeting 27.3
successful 26.6
confident 26.4
team 26
attractive 25.9
handsome 25.9
career 24.6
building 24.1
company 23.3
group 22.6
success 22.5
smile 22.1
worker 21.6
formal 21
teamwork 20.4
colleagues 19.4
clothing 19.3
partner 19.3
lifestyle 18.8
working 17.7
portrait 17.5
laptop 17.3
communication 16.8
corporation 16.4
employee 16.2
manager 15.8
workplace 15.3
sitting 14.6
looking 14.4
alone 13.7
busy 13.5
partnership 13.5
happiness 13.3
modern 13.3
pretty 13.3
together 13.2
men 12.9
indoor 12.8
businessperson 12.7
smiling 12.3
couple 12.2
standing 12.2
20s 11.9
casual 11.9
businessmen 11.7
holding 11.6
talking 11.4
smart 11.3
computer 11.2
notebook 11.2
expression 11.1
black 11.1
occupation 11
coworkers 10.8
leadership 10.6
confidence 10.5
boss 10.5
tie 10.4
table 10.4
face 10
lady 9.7
employment 9.7
diversity 9.6
women 9.5
guy 9.4
outside 9.4
secretary 9.3
friendly 9.2
waiter 9
technology 8.9
businesswomen 8.8
diverse 8.8
handshake 8.8
hands 8.7
staff 8.6
ethnic 8.6
contemporary 8.5
outdoor 8.4
jacket 8
discussing 7.9
colleague 7.8
good looking 7.8
color 7.8
partners 7.8
serious 7.6
two 7.6
mature 7.4
document 7.4
room 7.4
phone 7.4
cheerful 7.3

Google
created on 2022-01-08

Black 89.6
Bookcase 87.5
Sleeve 87.1
Shelf 84.3
Picture frame 83.9
Style 83.9
Black-and-white 83.8
Collar 83.5
Tie 81.7
Blazer 76.1
Monochrome photography 75.2
Snapshot 74.3
Formal wear 74.2
Monochrome 73.5
Publication 72
Vintage clothing 68.6
Dress shirt 65.1
Sitting 64.7
Shelving 63.4
Stock photography 63.1

Microsoft
created on 2022-01-08

text 100
person 99.5
sitting 96.9
man 94.7
clothing 93.3
black and white 82.4
suit 76
book 75.6
black 70.6
furniture 66.1
human face 62.7
old 52.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Calm 97.9%
Surprised 0.7%
Happy 0.4%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Male, 98.4%
Confused 63.5%
Surprised 12.2%
Sad 7.3%
Fear 6.6%
Calm 4.9%
Happy 2.7%
Angry 1.9%
Disgusted 0.8%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 97.8%
Person 97.5%
Couch 69.4%

Captions

Microsoft

a man wearing a suit and tie sitting in a library 94.1%
a man in a suit and tie sitting in a library 94%
a man wearing a suit and tie sitting in front of a window 93.9%

Text analysis

Amazon

CILBERT
SULLIVAN
---

Google

1MIM
1MIM