Human Generated Data

Title

Seward Park (or Hester Park, New York City)
Date

1932-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2781
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Seward Park (or Hester Park, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Accessories 99.8
Accessory 99.8
Tie 99.8
Apparel 99.7
Clothing 99.7
Human 99.6
Person 99.6
Person 99.2
Hat 98.7
Suit 94.5
Overcoat 94.5
Coat 94.5
Suit 93.8
Hat 92.8
Tie 90.9
Glasses 88.8
Military Uniform 66.3
Officer 66.3
Military 66.3
Tie 63.5
Sitting 62.6
Finger 61.3
Sun Hat 59.1
People 59
Building 56
Architecture 56

Clarifai
created on 2018-03-23

people 100
adult 99.4
group 99.1
two 98.7
portrait 98.5
leader 98.4
wear 97.8
administration 97.4
man 97.2
group together 97
several 95.9
three 95.6
lid 94.5
veil 94.5
outfit 94.3
facial expression 93.8
actor 93.5
one 93
music 92.1
chair 88.7

Imagga
created on 2018-03-23

man 48.4
male 42.5
portrait 33
person 29
suit 27.9
people 24.5
bow tie 24.5
businessman 22.9
face 22.7
hat 22.4
business 21.9
senior 21.6
necktie 20.5
adult 20
handsome 18.7
old 17.4
clothing 17.1
tie 16.1
grandfather 14.8
jacket 14.7
men 14.6
guy 14.1
executive 13.9
professional 13.9
attractive 13.3
corporate 12.9
success 12.9
one 12.7
black 12.6
currency 12.6
garment 12.5
smiling 12.3
office 12
glasses 12
expression 11.9
money 11.9
head 11.8
smile 11.4
hand 11.4
look 11.4
happy 11.3
vintage 10.7
standing 10.4
manager 10.2
dollar 10.2
human 9.7
looking 9.6
ruler 9.6
hair 9.5
mature 9.3
successful 9.1
covering 9.1
confident 9.1
headdress 9
couple 8.7
serious 8.6
smart 8.5
finance 8.4
beard 8.4
masculine 7.8
elegant 7.7
close 7.4
cash 7.3
art 7.3

Google
created on 2018-03-23

gentleman 82.2
human behavior 81.2
black and white 79.3
glasses 77.4
vision care 73.2
headgear 63
monochrome 59.2
monochrome photography 54.9
vintage clothing 53.4
sunglasses 51.2

Microsoft
created on 2018-03-23

person 99.8
man 98.4
outdoor 95.3
military uniform 82.3
older 34

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 96.5%
Disgusted 7.5%
Surprised 6.8%
Sad 38.5%
Calm 28.9%
Angry 8%
Happy 4.9%
Confused 5.3%

AWS Rekognition

Age 48-68
Gender Male, 98.5%
Calm 50.3%
Surprised 6.2%
Confused 11.7%
Angry 11.7%
Sad 5.9%
Happy 4.9%
Disgusted 9.3%

Microsoft Cognitive Services

Age 78
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Person 99.6%
Hat 98.7%
Suit 94.5%
Glasses 88.8%

Captions

Microsoft

a man wearing a black hat 96.1%
a man wearing a uniform 96%
a man wearing a hat 95.9%