Human Generated Data

Title

Mr. Johnson, seated; Blake Avenue, New York
Date

1965
People

Artist: Frank Espada, American 1930 - 2014
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2018.102
Copyright

© Frank Espada Photography

Human Generated Data

Title

Mr. Johnson, seated; Blake Avenue, New York

People

Artist: Frank Espada, American 1930 - 2014

Date

1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 99.5
Apparel 99.5
Human 96.6
Person 96.6
Plaid 70
Tartan 70
Painting 69.9
Art 69.9
Skirt 68.8
Man 67.2
Kilt 58.5

Clarifai
created on 2018-08-22

people 99.9
portrait 99.2
one 99.1
adult 97.6
man 97.4
wear 95.8
facial hair 93.7
administration 89.6
leader 86.6
music 83.6
musician 82.9
sit 82
outerwear 81.8
outfit 81.2
facial expression 80.6
mustache 79.6
furniture 77.7
veil 77
writer 75.9
military 75.9

Imagga
created on 2018-08-22

mask 33.3
statue 32.6
device 29.5
sculpture 25.6
man 21.5
religion 20.6
male 20.6
gag 20.2
covering 19.9
ancient 19.9
person 18.8
culture 17.9
art 17.8
portrait 17.5
protective covering 17.1
history 17
restraint 16.7
armor 16.1
people 15.1
old 14.6
black 14.6
helmet 13.7
clothing 13.5
god 13.4
travel 13.4
religious 13.1
elevator 12.9
temple 12.8
face 12.8
stone 12.6
military 12.6
historical 12.2
monument 12.1
figure 11.9
historic 11.9
protection 11.8
armor plate 11.8
soldier 11.7
antique 11.4
architecture 10.9
tourist 10.9
dark 10.9
warrior 10.7
war 10.6
bust 10.6
human 10.5
golden 10.3
lifting device 10.3
famous 10.2
body armor 10.1
weapon 9.6
east 9.3
traditional 9.1
vintage 9.1
tourism 9.1
breastplate 9.1
fashion 9
disguise 9
style 8.9
army 8.8
marble 8.7
spirituality 8.6
spiritual 8.6
city 8.3
shield 8.2
costume 8.1
suit 8.1
uniform 8
posing 8
building 7.9
catholic 7.8
adult 7.8
worship 7.7
faith 7.7
decoration 7.3
sword 7.3
attire 7.3
pose 7.2
plate 7.2
body 7.2

Google
created on 2018-08-22

photograph 96
standing 85.8
snapshot 81.8
vintage clothing 81.4
gentleman 77
black and white 75.9
human behavior 74
portrait 65.5
monochrome 56.5
stock photography 53.6
facial hair 51.6

Microsoft
created on 2018-08-22

person 97.5
text 95.4
book 94.4
white 63.8
old 43.9

Face analysis

Amazon

Google

AWS Rekognition

Age 48-68
Gender Male, 97.6%
Calm 21.8%
Surprised 3.7%
Confused 6.4%
Disgusted 2.1%
Happy 2.7%
Sad 56.9%
Angry 6.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Painting 69.9%

Captions

Microsoft

a black and white photo of a man 89.3%
a man holding a book 61.7%
an old photo of a man 61.6%

Text analysis

Amazon

6-
gsk
Tonsm
m Tonsm gsk 6-
m