Human Generated Data

Title

Untitled (Seward Park, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2835

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Seward Park, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2835

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-18

Clothing 100
Coat 100
Blazer 99.9
Jacket 99.9
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Electrical Device 98.7
Microphone 98.7
Adult 98.2
Male 98.2
Man 98.2
Person 98.2
People 97.7
Head 97.4
Formal Wear 97.2
Suit 97.2
Face 96.3
Crowd 92
Accessories 88.9
Hat 80.3
Photography 79.1
Tie 70.8
Portrait 66.8
Sitting 65.4
City 61.2
Person 57.5
Smoke 57.2
Shirt 56.5
Audience 56.2
Overcoat 56.1
Body Part 55.4
Finger 55.4
Hand 55.4

Clarifai
created on 2023-10-18

people 100
group 99.3
man 99.2
adult 98.9
portrait 98.7
leader 97.6
street 97.4
two 97.2
group together 96.7
administration 96
three 95.7
several 94.4
elderly 92.9
wear 90.8
four 89
monochrome 85.4
lid 84.6
chair 82.5
veil 81.9
many 80.5

Imagga
created on 2018-12-21

man 31.6
male 27
old 26.5
person 26
kin 23.3
statue 22
people 19.5
portrait 17.5
scholar 17.3
ancient 17.3
grandfather 17.2
sculpture 16.2
senior 15.9
uniform 15.3
military uniform 14.9
religion 14.3
intellectual 13.8
history 13.4
vintage 13.2
adult 12.9
smile 12.8
one 12.7
antique 12.1
men 12
clothing 11.8
business 11.5
face 11.4
mature 11.2
love 11
handsome 10.7
happy 10.7
god 10.5
look 10.5
art 10.4
religious 10.3
architecture 10.2
sepia 9.7
businessman 9.7
world 9.6
looking 9.6
spiritual 9.6
suit 9.4
money 9.4
monument 9.3
city 9.1
family 8.9
catholic 8.9
closeup 8.8
building 8.7
jacket 8.7
lifestyle 8.7
elderly 8.6
professional 8.6
sitting 8.6
serious 8.6
culture 8.5
old-timer 8.5
stone 8.4
dollar 8.4
church 8.3
room 8.3
human 8.2
covering 8.2
aged 8.1
symbol 8.1
bank 8.1
success 8
daily 8
newspaper 7.9
work 7.8
couple 7.8
marble 7.7
outdoor 7.6
savings 7.5
office 7.4
consumer goods 7.3
indoor 7.3
home 7.2
currency 7.2
beard 7.2
to 7.1

Google
created on 2018-12-21

Microsoft
created on 2018-12-21

person 100
outdoor 99.3
man 90.8
old 85.2
people 76.7
older 40.1
crowd 1.4
street 0.5
hat 0.2
retro 0.2
black and white 0.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 100%
Confused 30.5%
Angry 29.8%
Calm 24.1%
Sad 13.2%
Surprised 6.6%
Fear 6.2%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 54-62
Gender Male, 99.3%
Calm 89%
Fear 6.4%
Surprised 6.4%
Confused 5.7%
Sad 2.6%
Angry 1.4%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 54-64
Gender Male, 99.2%
Calm 74%
Sad 21.3%
Surprised 6.5%
Fear 6%
Angry 4.7%
Confused 2.2%
Disgusted 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Male 99.6%
Man 99.6%
Person 99.6%
Suit 97.2%
Hat 80.3%
Tie 70.8%

Categories