Human Generated Data

Title

Untitled (Lower East Side, New York City)
Date

1933-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.15
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.1
Person 99.1
Apparel 95.4
Clothing 95.4
Man 72.4
Building 70.9
Architecture 70.9
Finger 70.5
Pillar 64.3
Column 64.3
Undershirt 64.1
Archaeology 62
Shorts 59.3

Clarifai
created on 2018-03-23

people 99.9
one 99.4
adult 99.1
man 96
wear 94.4
administration 94.1
portrait 93.8
two 91.5
music 88.5
leader 86.8
woman 86.8
outfit 86.5
musician 79.8
doorway 78.9
group 78.1
writer 77.4
home 76.9
theater 75.9
room 75.2
veil 74.7

Imagga
created on 2018-03-23

person 34.1
adult 27.2
portrait 27.2
man 26.9
male 24.3
people 22.9
sexy 20.1
attractive 19.6
lifestyle 18.1
model 17.1
face 17
body 16.8
adolescent 16.6
human 16.5
posing 16
juvenile 14.7
pretty 14.7
expression 14.5
fitness 14.5
fashion 14.3
one 14.2
black 14.1
exercise 12.7
lady 12.2
sensuality 11.8
sport 11.6
guy 11.5
happy 11.3
love 11
dark 10.9
cool 10.7
wall 10.4
strength 10.3
training 10.2
blond 10
dress 9.9
handsome 9.8
old 9.8
world 9.7
standing 9.6
muscular 9.6
casual 9.3
smile 9.3
emotion 9.2
sensual 9.1
pose 9.1
health 9
hair 8.7
couple 8.7
serious 8.6
art 8.5
grunge 8.5
vintage 8.3
alone 8.2
healthy 8.2
style 8.2
athlete 8
cute 7.9
sexual 7.7
outdoor 7.6
balance 7.6
elegance 7.6
relaxation 7.5
temple 7.4
statue 7.3
active 7.2

Google
created on 2018-03-23

photograph 95.5
snapshot 81.8
black and white 80.3
male 79.9
photography 78.9
standing 76.5
portrait 62
human behavior 58.4
gentleman 58.2
vintage clothing 57.6
monochrome photography 55.4

Microsoft
created on 2018-03-23

man 95.3
person 90.4
standing 88.5
outdoor 85.3
black 72.5
posing 65.5
old 45.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 90%
Confused 5.6%
Surprised 1.9%
Happy 3.9%
Angry 4.2%
Disgusted 64.3%
Sad 3.1%
Calm 17%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a man standing in front of a door 83.9%
a man standing in front of a building 82.4%
a black and white photo of a man 77.3%