Human Generated Data

Title

Untitled (Sixth Avenue, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2870
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Hat 99
Face 86.4
Sun Hat 84.7
Overcoat 74.4
Coat 74.4
Sleeve 65.6
Portrait 65.4
Photo 65.4
Photography 65.4
Finger 64.3
Suit 58.2
Undershirt 57

Clarifai
created on 2018-03-23

people 99.7
one 99.4
portrait 98.5
adult 98.3
wear 96.1
man 94.6
offense 90.9
lid 89.9
outerwear 88.4
veil 87.8
indoors 87.3
woman 85.7
music 85
musician 83.9
street 82.5
outfit 82.1
door 81.8
coat 80.6
doorway 80.5
administration 78.7

Imagga
created on 2018-03-23

hat 81.1
cowboy hat 40.4
person 39
headdress 34.5
portrait 33
man 30.9
clothing 30.4
male 27.7
face 27
adult 26.5
people 26.2
black 24.7
fashion 23.4
attractive 21.7
model 20.2
guy 19.6
looking 18.4
happy 17.5
suit 17.2
style 17.1
dark 16.7
smile 16.4
lady 16.2
sombrero 16.2
pretty 15.4
sexy 15.3
hand 15.2
handsome 15.1
posing 15.1
covering 15.1
human 15
look 14.9
expression 14.5
elevator 13.7
studio 13.7
cute 13.6
one 13.4
serious 13.3
consumer goods 13
hair 12.7
smiling 12.3
elegant 12
cowboy 11.8
pose 11.8
men 11.2
lifting device 11
business 10.9
retro 10.7
eyes 10.3
senior 10.3
shirt 10.3
love 10.3
smoke 10.2
youth 10.2
casual 10.2
vintage 9.9
device 9.8
old 9.8
businessman 9.7
mystery 9.6
boy 9.6
standing 9.6
umbrella 9.6
holding 9.1
blond 9
fun 9
cap 8.9
costume 8.8
western 8.7
women 8.7
lifestyle 8.7
wearing 8.6
smart 8.5
head 8.4
girls 8.2
eye 8
adolescent 7.9
couple 7.8
attitude 7.8
mysterious 7.8
old-timer 7.6
confident 7.3
sensuality 7.3
make 7.3
romantic 7.1
cool 7.1
worker 7.1
interior 7.1
work 7.1
happiness 7

Google
created on 2018-03-23

photograph 94.9
snapshot 81.8
black and white 78
gentleman 70.5
darkness 57.5
vintage clothing 56.9
portrait 55.5
film noir 54.6
monochrome photography 51

Microsoft
created on 2018-03-23

person 99.8
hat 97.9
man 97.8
wearing 83.5
white 73
black 70.7
old 57.9

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 90.8%
Calm 7.8%
Surprised 1.1%
Happy 3.2%
Sad 52.1%
Disgusted 27.6%
Confused 4.5%
Angry 3.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 99%

Captions

Microsoft

a man wearing a black hat 97.3%
a man wearing a hat 97.2%
a man wearing a black hat and looking at the camera 95.7%