Human Generated Data

Title

14th St. (New York City)
Date

1932-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3122
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

14th St. (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3122

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Tie 99.8
Accessories 99.8
Accessory 99.8
Coat 99.2
Apparel 99.2
Clothing 99.2
Suit 99.2
Overcoat 99.2
Human 99.1
Person 99.1
Person 98.2
Finger 81.2
Crowd 78.1
Hat 75.7
Face 60.2
Blonde 57.6
Woman 57.6
Child 57.6
Girl 57.6
Kid 57.6
Teen 57.6
Female 57.6
Home Decor 56.5
Linen 56.5
People 55.5

Clarifai
created on 2018-03-16

people 100
adult 99.2
one 97
portrait 96.9
two 96.7
man 96.6
group 96.3
administration 96.1
music 95.3
wear 94.6
three 94.3
leader 94.1
outfit 92.8
actor 92.4
group together 92.2
several 89.6
movie 89.3
musician 87.2
four 87.2
facial expression 86.8

Imagga
created on 2018-03-16

man 51.8
male 46.1
person 40.3
portrait 34.3
suit 33.6
businessman 29.2
adult 28.5
people 28.5
performer 27.8
face 26.3
handsome 25
business 24.9
comedian 23.1
tie 21.8
expression 20.5
black 20.1
entertainer 19.6
look 18.4
looking 16
human 15.8
phone 14.8
guy 14.8
office 14.5
happy 14.4
professional 14.3
men 13.7
dark 13.4
executive 13.3
confident 12.7
head 12.6
attractive 12.6
lifestyle 12.3
mobile 12.3
couple 12.2
eyes 12.1
glasses 12
old 11.9
smile 11.4
double 11.2
corporate 11.2
hair 11.1
cellphone 10.7
bow tie 10.5
one 10.5
sexy 10.4
beard 10.4
senior 10.3
love 10.3
manager 10.2
mature 10.2
smiling 10.1
eye 9.8
fashion 9.8
pretty 9.8
success 9.7
hand 9.1
device 9
necktie 8.9
masculine 8.8
cell 8.6
serious 8.6
elegant 8.6
telephone 8.5
communication 8.4
studio 8.4
jacket 8.3
vintage 8.3
mustache 8.2
style 8.2
model 7.8
call 7.8
musician 7.6
talking 7.6
shirt 7.5
holding 7.4
funny 7.3
successful 7.3
singer 7.2
husband 7.1
work 7.1
happiness 7.1

Google
created on 2018-03-16

photograph 95.1
black and white 80.8
gentleman 78
vintage clothing 70.9
human behavior 70.4
facial hair 68.7
monochrome photography 54.2
monochrome 52.8

Microsoft
created on 2018-03-16

person 99.9
man 91.6
suit 69.3
necktie 18

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 74.4%
Disgusted 2.4%
Surprised 2.9%
Happy 3.6%
Confused 10.2%
Calm 4.3%
Sad 70.8%
Angry 5.8%

AWS Rekognition

Age 57-77
Gender Male, 97.6%
Surprised 0.4%
Confused 0.7%
Disgusted 0.5%
Calm 95.8%
Angry 0.6%
Sad 1.8%
Happy 0.2%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Suit 99.2%
Person 99.1%
Hat 75.7%

Categories

Imagga

paintings art 68.3%
people portraits 31.2%
pets animals 0.3%
food drinks 0.1%
nature landscape 0.1%