Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3148
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3148

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Sun Hat 99.8
Adult 97.7
Male 97.7
Man 97.7
Person 97.7
Person 97.3
Baby 97.3
Person 97.3
Baby 97.3
Adult 97.1
Male 97.1
Man 97.1
Person 97.1
Face 94.7
Head 94.7
Adult 94.2
Male 94.2
Man 94.2
Person 94.2
Adult 92.6
Male 92.6
Man 92.6
Person 92.6
Person 92.3
Adult 91.7
Male 91.7
Man 91.7
Person 91.7
People 90.4
Adult 90
Male 90
Man 90
Person 90
Person 87.6
Hat 85.9
Adult 85.1
Male 85.1
Man 85.1
Person 85.1
Crowd 85
Person 81.9
Person 81.5
Person 78.9
Person 78.5
Person 74.1
Hat 72.5
Hat 69
Person 66.3
Person 63.9
Hat 61.7
Person 58.4
Coat 57.8
Hat 57.4
Hat 57.1
Hat 56.7

Clarifai
created on 2018-05-10

people 100
many 100
veil 99.9
group together 99.5
group 99.4
wear 98.7
adult 98.4
lid 98.2
uniform 98
man 97.9
crowd 97.8
fedora 97.8
outfit 96.9
leader 95.3
baseball 94.5
administration 94.4
spectator 94.3
military 94.1
recreation 92.2
audience 91.7

Imagga
created on 2023-10-05

cowboy hat 100
hat 100
headdress 93.3
clothing 63.2
consumer goods 34.1
covering 33.8
old 18.8
statue 18
sculpture 15.3
travel 13.4
culture 11.9
history 11.6
male 11.3
ancient 11.2
stone 11
architecture 10.9
man 10.7
art 10.4
tourism 9.9
religion 9.8
china 9.5
people 9.5
face 9.2
city 9.1
business 9.1
building 8.7
heritage 8.7
industry 8.5
religious 8.4
symbol 8.1
agriculture 7.9
monument 7.5
person 7.3
industrial 7.3
black 7.2
portrait 7.1

Google
created on 2018-05-10

black and white 91.3
monochrome photography 82
crowd 81.6
monochrome 72.3
militia 70.6
headgear 66.6
troop 59.3

Microsoft
created on 2018-05-10

person 96
player 69.9
crowd 2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 52.8%
Surprised 21.4%
Confused 11.8%
Fear 8.6%
Sad 4.9%
Angry 2.7%
Happy 2.6%
Disgusted 1.7%

AWS Rekognition

Age 41-49
Gender Male, 100%
Sad 99.7%
Calm 32.3%
Surprised 6.3%
Fear 5.9%
Angry 0.4%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 95.9%
Surprised 6.4%
Fear 6%
Sad 2.8%
Angry 1.4%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 97.8%
Surprised 6.7%
Fear 5.9%
Sad 2.3%
Confused 0.4%
Angry 0.3%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 96.9%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Confused 0.9%
Angry 0.5%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 91%
Surprised 8.6%
Fear 6.1%
Sad 2.6%
Confused 1.3%
Angry 0.9%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 72.2%
Surprised 13.5%
Fear 7.2%
Angry 4.5%
Confused 3.4%
Sad 3.4%
Happy 1.8%
Disgusted 1.6%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 85.5%
Surprised 7.3%
Fear 5.9%
Sad 5.8%
Confused 3.9%
Angry 0.7%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 95.7%
Surprised 6.6%
Fear 5.9%
Sad 2.4%
Confused 2%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 91.3%
Calm 40.2%
Surprised 7.8%
Fear 6.5%
Angry 5.4%
Happy 3%
Confused 2.6%
Disgusted 1.1%

AWS Rekognition

Age 33-41
Gender Male, 99.4%
Sad 96.3%
Calm 20.2%
Surprised 16%
Confused 9.3%
Fear 6.1%
Happy 3%
Angry 2.8%
Disgusted 2.4%

AWS Rekognition

Age 27-37
Gender Male, 100%
Happy 73.6%
Surprised 9.3%
Fear 6.5%
Sad 6.3%
Calm 6.2%
Confused 2.2%
Angry 2.1%
Disgusted 1.2%

AWS Rekognition

Age 22-30
Gender Male, 91.6%
Calm 93%
Surprised 6.4%
Fear 5.9%
Sad 4.8%
Happy 0.3%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98.4%
Sad 100%
Surprised 6.3%
Fear 6.2%
Calm 3.4%
Happy 0.5%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 93.8%
Surprised 6.8%
Fear 6.5%
Sad 2.4%
Angry 1.5%
Happy 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 24-34
Gender Female, 87.7%
Calm 92%
Surprised 6.4%
Fear 5.9%
Happy 3.9%
Sad 2.8%
Confused 1.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 22-30
Gender Female, 51.6%
Sad 74.4%
Calm 37.6%
Disgusted 18.6%
Fear 6.8%
Surprised 6.8%
Happy 3.6%
Angry 1.6%
Confused 0.9%

AWS Rekognition

Age 16-24
Gender Male, 97.6%
Calm 67.7%
Sad 45.5%
Fear 6.5%
Surprised 6.4%
Happy 3%
Confused 1%
Disgusted 0.5%
Angry 0.4%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 62
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 97.7%
Male 97.7%
Man 97.7%
Person 97.7%
Baby 97.3%
Hat 85.9%