Human Generated Data

Title

East Side Merchant (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2854

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

East Side Merchant (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 98.7
Human 98.7
Clothing 95
Apparel 95
Market 85.1
Food 80
Shop 73.6
Bazaar 73.6
Creme 60.1
Dessert 60.1
Cake 60.1
Cream 60.1
Icing 60.1

Clarifai
created on 2018-03-23

people 100
one 99.6
adult 99.2
portrait 98.7
woman 97.8
two 96.9
wear 95.8
man 94.2
street 91.7
group 91.5
veil 89.1
merchant 87.9
three 87.4
administration 81.9
monochrome 81.6
four 81.6
outerwear 81
facial expression 79.6
war 78.2
child 76.5

Imagga
created on 2018-03-23

person 27.8
chain mail 24.7
armor 23
statue 22.5
body armor 20.1
face 19.9
man 19.5
fan 18.3
sculpture 18.1
temple 17.5
religion 17
rustic 16.8
old 16
people 15.6
traditional 15
portrait 14.9
follower 14.8
history 14.3
culture 13.7
adult 13.6
architecture 13.3
ancient 13
art 12.7
male 11.3
religious 11.2
covering 11
stone 11
protection 10.9
industrial 10.9
world 10.9
protective covering 10.6
travel 10.6
human 10.5
one 10.4
antique 10.4
east 10.3
industry 10.2
expression 10.2
mask 10.2
historic 10.1
clothing 9.9
gold 9.9
fashion 9.8
black 9.6
building 9.6
dark 9.2
outdoors 9
costume 8.8
body 8.8
helmet 8.7
war 8.7
spiritual 8.6
smile 8.5
ruler 8.4
monument 8.4
hat 8.3
work 8.2
happy 8.1
water 8
soldier 7.8
worship 7.7
attractive 7.7
medieval 7.7
meditation 7.7
god 7.6
hand 7.6
city 7.5
place 7.4
emotion 7.4

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Female, 97.2%
Sad 44.3%
Calm 19.3%
Angry 21.2%
Surprised 1.9%
Confused 2.2%
Happy 3.4%
Disgusted 7.7%

Microsoft Cognitive Services

Age 77
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a man and a woman sitting on a table 28.3%
a man and a woman sitting at a table 28.2%
a person sitting on a table 28.1%

Text analysis

Amazon

ORD
Meie ORD
Meie