Human Generated Data

Title

Untitled (men playing cards, New York, New York)

Date

1939, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men playing cards, New York, New York)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Furniture 99.2
Chair 99.2
Person 99
Human 99
Person 98.8
Person 98.7
Person 98.5
Person 98.4
Person 97.8
Chair 97.3
Apparel 97.2
Clothing 97.2
Person 96.8
Person 96.5
Person 95.3
Person 95
Accessories 94.8
Tie 94.8
Accessory 94.8
Overcoat 94.8
Coat 94.8
Person 94
Suit 93.6
Sitting 93.5
Person 93.2
Tie 93
Suit 91.5
Restaurant 82.5
Tuxedo 81.4
Indoors 81.4
Room 81.2
Crowd 79.1
Tie 76
Chair 75.5
Table 71.5
Food 67.4
Meal 67.4
People 65.1
Pub 59.7
Portrait 58.6
Photo 58.6
Face 58.6
Photography 58.6
Cafeteria 58.2
Cafe 55.6

Imagga
created on 2022-01-08

businessman 53
meeting 50.9
business 50.4
office 50.3
executive 40.5
businesswoman 40
man 39.7
corporate 39.5
male 39
group 38.7
team 38.5
people 37.4
person 37
teamwork 34.3
work 33.8
entrepreneur 33.5
professional 33
table 30.4
businesspeople 30.4
happy 30.1
men 29.2
colleagues 29.2
communication 26.9
suit 25.4
desk 24.7
room 24.5
adult 24.2
job 23.9
businessmen 22.4
smiling 22.4
working 22.1
laptop 22.1
conference 21.5
classroom 21.3
computer 20.9
together 20.2
sitting 19.8
worker 18.9
teacher 18.6
manager 18.6
smile 18.5
success 18.5
talking 18.1
company 17.7
discussion 17.5
coworkers 16.7
cooperation 16.4
corporation 16.4
career 16.1
presentation 15.8
women 15.8
indoors 15.8
workplace 15.3
discussing 14.7
cheerful 14.6
indoor 14.6
mature 14
associates 13.8
successful 13.7
staff 13.7
lifestyle 13
occupation 12.8
confident 12.7
partnership 12.5
handsome 12.5
boss 12.4
restaurant 12.2
hall 12.2
building 12.1
education 12.1
modern 11.9
collaboration 11.8
employee 11.8
diverse 11.7
portrait 11.7
diversity 11.5
center 11.5
looking 11.2
happiness 11
businesswomen 10.8
interior 10.6
30s 10.6
educator 10.6
technology 10.4
contemporary 10.3
20s 10.1
board 10
40s 9.7
partners 9.7
partner 9.7
busy 9.6
black 9.6
four 9.6
couple 9.6
gesture 9.5
ethnic 9.5
face 9.2
horizontal 9.2
attractive 9.1
color 8.9
explaining 8.9
seminar 8.9
life 8.8
jacket 8.8
mid adult 8.7
planning 8.7
formal 8.6
females 8.5
casual 8.5
showing 8.4
coffee 8.3
camera 8.3
chair 7.9
associate 7.9
day 7.9
agreement 7.8
collar 7.7
finance 7.6
plan 7.6
pen 7.5
training 7.4
friendly 7.3
scholar 7

Google
created on 2022-01-08

Coat 90.1
Black 89.7
Chair 83.6
Suit 80.7
Hat 75.3
Font 75.1
Event 71.8
White-collar worker 68.8
Monochrome 68.7
Vintage clothing 67.2
Monochrome photography 65.6
Stock photography 64.8
Crew 64.2
Room 63.9
History 63.8
Photo caption 63
Sitting 62.1
Formal wear 60.8
Team 60.5
Sun hat 56.1

Microsoft
created on 2022-01-08

text 99.9
person 98.9
clothing 97.3
furniture 92.8
man 91.4
group 86.5
chair 81.7
table 79.1
people 66.6
book 53.2
posing 42.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Happy 99.6%
Calm 0.1%
Surprised 0.1%
Sad 0%
Disgusted 0%
Fear 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 69.3%
Sad 14.7%
Confused 5.9%
Angry 2.6%
Fear 2.6%
Surprised 1.9%
Happy 1.7%
Disgusted 1.3%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 83.8%
Sad 7.4%
Confused 4.6%
Angry 2.1%
Surprised 0.9%
Disgusted 0.6%
Fear 0.4%
Happy 0.2%

AWS Rekognition

Age 54-64
Gender Male, 98.4%
Calm 85.9%
Sad 4.8%
Confused 2.8%
Angry 2.7%
Disgusted 1.3%
Surprised 1.2%
Fear 1%
Happy 0.4%

AWS Rekognition

Age 39-47
Gender Male, 100%
Happy 70.8%
Calm 20.5%
Confused 3.6%
Disgusted 2.1%
Surprised 1.1%
Sad 0.7%
Fear 0.6%
Angry 0.6%

AWS Rekognition

Age 33-41
Gender Male, 99.1%
Calm 94%
Confused 3.4%
Sad 1%
Disgusted 0.7%
Angry 0.5%
Surprised 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Happy 96%
Calm 1.3%
Surprised 0.6%
Confused 0.6%
Angry 0.5%
Sad 0.4%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 98.2%
Sad 1.1%
Confused 0.4%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Sad 87.4%
Calm 9%
Disgusted 1.1%
Confused 1.1%
Angry 0.5%
Happy 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 92.1%
Happy 2.1%
Disgusted 2%
Surprised 1.3%
Confused 0.9%
Sad 0.9%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 92%
Sad 6%
Angry 0.7%
Confused 0.5%
Disgusted 0.3%
Surprised 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 97.8%
Calm 43.5%
Fear 27.5%
Angry 10.4%
Sad 7.9%
Surprised 5%
Confused 3.5%
Disgusted 1.7%
Happy 0.6%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.2%
Person 99%
Tie 94.8%
Suit 93.6%

Captions

Microsoft

a group of people posing for a photo 94.8%
a group of people posing for the camera 94.7%
a group of people posing for a picture 94.6%

Text analysis

Amazon

84
1939
New
Joe
66%
York
New York, New York
Studio
THE
ATTENTION
York,
FLOOR
Steinmetz Studio
SPITTING
NO SPITTING ON THE FLOOR
Only
Steinmetz
220
NO
ON
ATTENTION PLEASE
Club
la
PLEASE
.12
this
Members Only Allewed
Allewed
la Stay if this Club
Stay
EXECUTIVE
Members
This
Un
This Meers Un
if
Meers
FE

Google

PLEASE!
eTTING
2
Joe
ATTENTION PLEASE! this Club No eTTING ON THE DAS AEMERS 84 66% .12 2 20 Joe Steinmetz Studio New York, New York 1939
this
Club
AEMERS
York
ATTENTION
DAS
66%
.12
1939
No
ON
THE
Studio
New
84
20
Steinmetz
York,