Human Generated Data

Title

Untitled (New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2961
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2961

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Fence 99.6
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Cap 99.3
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
People 99.2
Baseball Cap 90.1
Hat 77.5
Prison 77.1
Coat 71.6
Coat 70.1
Hat 60.3
Overcoat 57.6
Jacket 56.8
Glove 55.2

Clarifai
created on 2018-05-10

people 99.9
adult 98
two 97.3
wear 96.9
three 96.7
group together 96.4
man 95.1
portrait 95
veil 94.5
administration 94
outfit 93.7
uniform 92.1
group 91.2
lid 91
leader 90.5
military 89.9
baseball 89.2
one 88.9
war 87.8
barbed wire 87.7

Imagga
created on 2023-10-06

fence 42.9
man 36.3
male 35.6
hat 33.9
person 29.8
prison 29.7
batting cage 24.1
barrier 22.5
people 20.6
baseball equipment 19.7
adult 19.4
sport 18.7
senior 16.9
correctional institution 16.8
portrait 16.2
sports equipment 15.8
outdoors 15.7
smiling 14.5
handsome 14.3
old 13.9
happy 13.8
guy 13.2
industry 12.8
penal institution 12.6
obstruction 12.3
face 12.1
net 11.4
uniform 11.3
looking 11.2
men 11.2
clothing 11
elderly 10.5
boy 10.4
shirt 10.3
safety 10.1
athlete 9.7
western 9.7
wire 9.5
outside 9.4
institution 9.4
mature 9.3
smile 9.3
cowboy 9.2
field 9.2
security 9.2
hand 9.1
one 9
activity 9
game 8.9
worker 8.9
lifestyle 8.7
construction 8.5
military uniform 8.5
black 8.4
outdoor 8.4
protection 8.2
work 7.9
player 7.8
mesh 7.8
ballplayer 7.8
sky 7.6
style 7.4
sports 7.4
metal 7.2
aged 7.2
engineer 7.2
job 7.1
old-timer 7

Google
created on 2018-05-10

photograph 95.9
black 95.6
black and white 92.2
man 91.5
monochrome photography 85.2
photography 82.1
male 81.8
snapshot 81.8
monochrome 72.8
military officer 72.2
military person 70.3
stock photography 51.1

Microsoft
created on 2018-05-10

outdoor 88.6
old 51.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.5%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 91.6%
Surprised 6.4%
Fear 6%
Sad 3.1%
Angry 2.1%
Confused 1.4%
Disgusted 1.3%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 72.1%
Sad 21.3%
Surprised 6.7%
Confused 6.2%
Fear 6%
Angry 1.6%
Happy 0.9%
Disgusted 0.4%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Adult 99.3%
Male 99.3%
Man 99.3%
Hat 77.5%
Coat 71.6%

Captions

Microsoft
created on 2018-05-10

a black and white photo of a man 96.9%
a man standing in front of a fence 95.2%
an old photo of a man 95.1%