Human Generated Data

Title

Untitled (four men seated in Hookers Klub car on train)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8193
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men seated in Hookers Klub car on train)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8193

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99
Human 99
Clothing 98.9
Apparel 98.9
Person 98.6
Person 98.5
Person 95.3
Sitting 95.1
Person 94.7
Shirt 92.1
Tie 91.4
Accessories 91.4
Accessory 91.4
Suit 87.9
Overcoat 87.9
Coat 87.9
Tie 80.3
Person 71.2
Head 71.1
Dress Shirt 65
Person 60.2
Crowd 58.4
Audience 55.4

Clarifai
created on 2023-10-25

people 99.8
group 99.2
man 98.7
adult 98.1
group together 97.1
monochrome 96.3
indoors 95.5
woman 93.6
education 92.2
three 88.9
several 88.5
medical practitioner 85.4
uniform 85.2
five 84.6
many 84.3
portrait 81.7
science 81.1
hospital 78.1
wear 77.5
leader 76.2

Imagga
created on 2022-01-08

barbershop 48.1
man 39
shop 37.4
people 31.8
male 30.5
mercantile establishment 29.7
businessman 28.2
business 25.5
adult 24
person 23.7
office 20.4
place of business 19.8
team 17.9
meeting 17.9
colleagues 16.5
businesswoman 16.4
corporate 16.3
men 16.3
room 16.2
businesspeople 16.1
happy 15.7
portrait 15.5
old 15.3
casual 15.2
smiling 15.2
working 15
work 14.9
group 14.5
life 14.4
senior 14.1
executive 14
looking 13.6
professional 13.2
worker 13.2
mature 13
lifestyle 13
sitting 12.9
indoors 12.3
face 12.1
teamwork 12
occupation 11.9
20s 11.9
40s 11.7
color 11.7
table 11.2
women 11.1
day 11
aged 10.9
job 10.6
medical 10.6
30s 10.6
couple 10.5
talking 10.5
patient 10.3
camera 10.2
establishment 9.9
home 9.6
elderly 9.6
education 9.5
indoor 9.1
nurse 9.1
confident 9.1
coworkers 8.8
hands 8.7
mid adult 8.7
smile 8.5
career 8.5
desk 8.5
inside 8.3
classroom 8
family 8
interior 8
together 7.9
black 7.8
retired 7.8
four 7.7
world 7.6
horizontal 7.5
doctor 7.5
hairdresser 7.5
manager 7.4
successful 7.3
success 7.2
teacher 7.2
to 7.1
happiness 7.1
architecture 7

Google
created on 2022-01-08

Shirt 94.8
Coat 91.5
Black 89.5
Smile 86
Black-and-white 85.4
Tie 85.3
Style 83.9
Line 81.5
Suit 80.9
Adaptation 79.3
Font 78.8
Monochrome photography 76.6
Collar 76.5
Monochrome 75.2
Blazer 74.2
Event 71.8
White-collar worker 67.6
Room 67.4
Vintage clothing 65.9
Art 65.7

Microsoft
created on 2022-01-08

text 98.8
human face 95.2
person 89
clothing 88.7
man 84.3
smile 81.9
glasses 52.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 85%
Surprised 8.8%
Confused 2.3%
Sad 1.3%
Disgusted 1.2%
Happy 0.9%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 88.8%
Calm 6.5%
Confused 1.8%
Surprised 0.9%
Disgusted 0.9%
Sad 0.5%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 86.4%
Happy 90.8%
Sad 6%
Calm 1.2%
Angry 0.8%
Surprised 0.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 96.5%
Calm 97%
Sad 2.7%
Angry 0.1%
Happy 0.1%
Fear 0%
Confused 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Sad 54.5%
Happy 25.9%
Calm 15.1%
Disgusted 1.1%
Surprised 1.1%
Angry 1%
Confused 0.9%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99%
Person 98.6%
Person 98.5%
Person 95.3%
Person 94.7%
Person 71.2%
Person 60.2%
Tie 91.4%
Tie 80.3%

Categories

Imagga

streetview architecture 98%

Text analysis

Amazon

5140
10
DOHERTY
DOHERTY adidas
night
the
adidas

Google

1DOHERTY
1DOHERTY