Human Generated Data

Title

Untitled (New York City)
Date

1932-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2883
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2883

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 99.9
Overcoat 99.8
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 98.9
Male 98.9
Man 98.9
Person 98.9
Coat 91.3
Face 85.1
Head 85.1
Accessories 73.7
Formal Wear 73.7
Tie 73.7
Hat 66.5
Body Part 57.4
Hand 57.4
Hat 56.6
Suit 55.9
Smoke 55.8

Clarifai
created on 2018-05-10

people 100
group together 99.2
group 99
adult 98.9
wear 98.3
three 97.4
administration 97.2
man 96.9
several 96.7
two 95.8
leader 95.7
four 95.6
lid 95
veil 94.4
outfit 94.3
military 94.2
five 93.6
many 92
portrait 91.3
one 91

Imagga
created on 2023-10-06

hat 100
cowboy hat 80.4
clothing 53.4
headdress 49.3
man 44.3
male 39
uniform 28.3
person 28.2
consumer goods 26
military uniform 25.8
people 25.6
portrait 25.2
covering 24.1
adult 23.3
face 19.2
helmet 18.6
senior 17.8
black 17.4
men 17.2
smile 17.1
hand 15.9
worker 15.9
guy 15.6
old 15.3
cowboy 15.3
happy 15
handsome 14.3
work 14.1
industry 13.7
looking 13.6
western 13.6
two 13.5
attractive 13.3
model 13.2
occupation 12.8
job 12.4
one 11.9
engineer 11.8
boy 11.3
construction 11.1
suit 11.1
smiling 10.8
serious 10.5
couple 10.5
foreman 10.2
safety 10.1
business 9.7
style 9.6
building 9.5
hair 9.5
private 9.5
expression 9.4
shirt 9.3
professional 9.3
human 9
success 8.8
look 8.8
mysterious 8.7
architecture 8.6
casual 8.5
fashion 8.3
architect 7.7
mystery 7.7
wearing 7.6
engineering 7.6
pair 7.6
head 7.6
site 7.5
outdoors 7.5
equipment 7.4
pose 7.2
jacket 7.2
posing 7.1
love 7.1
together 7

Google
created on 2018-05-10

photograph 95.9
standing 91.1
military officer 86.2
military person 84.7
black and white 84
snapshot 81.8
vintage clothing 78.4
gentleman 74.8
staff 68
monochrome photography 66.2
history 63.1
monochrome 63
militia 59.5
soldier 57.9
troop 55.6
stock photography 53.9

Microsoft
created on 2018-05-10

person 99
old 98
outdoor 98
man 96.7
black 81.9
standing 81.7
white 70.7
people 60.1
vintage 37.4
helmet 21.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 94.4%
Surprised 6.5%
Fear 6%
Sad 3%
Angry 1.5%
Confused 0.7%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 58-66
Gender Male, 99.8%
Calm 48.7%
Happy 42.1%
Surprised 6.7%
Fear 6%
Sad 3.8%
Angry 2.1%
Confused 1.3%
Disgusted 0.6%

AWS Rekognition

Age 43-51
Gender Male, 100%
Sad 99.8%
Calm 26.2%
Surprised 6.3%
Fear 5.9%
Angry 1%
Confused 0.4%
Disgusted 0.3%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.9%
Adult 99.2%
Male 99.2%
Man 99.2%
Person 99.2%
Tie 73.7%
Hat 66.5%

Captions

Microsoft
created on 2018-05-10

an old black and white photo of a man 97.5%
a black and white photo of a man 96.9%
a vintage photo of a man 96.8%