Human Generated Data

Title

East Side Merchants (Lower East Side, New York City)
Date

April 1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3143
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

East Side Merchants (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.2
Human 99.2
Text 72.7
Apparel 71
Clothing 71
Leisure Activities 56.4
Advertisement 55.7
Poster 55.7

Clarifai
created on 2018-03-16

people 99.8
adult 98.8
one 94.5
man 94.1
military 91.9
wear 89.5
vehicle 87.2
illustration 85.4
bill 85.1
uniform 84.1
transportation system 83
text 81.9
war 81.8
two 81.6
portrait 81.1
no person 80.2
retro 79.7
group 79.6
woman 77.9
outfit 76.8

Imagga
created on 2018-03-16

blackboard 100
chalk 25.3
chalkboard 22.5
education 21.7
board 20.8
school 20.6
grunge 20.4
classroom 20.4
black 18
retro 18
drawing 16.3
card 16.2
class 15.4
teacher 15.4
design 15.2
frame 14.1
student 13.6
symbol 13.5
study 13.1
old 12.5
texture 12.5
graphic 12.4
art 12.4
college 12.3
business 12.2
vintage 11.6
university 11.5
learn 11.3
learning 11.3
message 10
hand 9.9
sign 9.8
lesson 9.7
information 9.7
people 8.9
math 8.8
teach 8.8
teaching 8.8
text 8.7
decoration 8.2
aged 8.1
border 8.1
dirty 8.1
paper 7.8
space 7.8
empty 7.7
modern 7.7
knowledge 7.7
person 7.7
writing 7.5
human 7.5
style 7.4
letter 7.3
success 7.2
color 7.2

Google
created on 2018-03-16

photograph 94.8
text 86.5
black and white 80.3
poster 74.6
art 73.3
font 72.1
advertising 59.3
monochrome 50.2

Microsoft
created on 2018-03-16

black 70.7
old 50.9
posing 37.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Disgusted 0.3%
Angry 2%
Calm 85.3%
Sad 9.9%
Happy 0.1%
Confused 2%
Surprised 0.4%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a black and white photo of a person 76.4%
an old photo of a person 76.3%
old photo of a person 76.2%

Text analysis

Amazon

RLapinkof
ADLER
y7y
y7y 15UN8YX ADLER RLapinkof
UTis
SI6WI
W'
URAY
15UN8YX
0700
YanS
UTis 1
1

Google

0700
0700