Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2978
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2978

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
People 99.5
Sun Hat 97.5
Person 97.1
Person 96.8
Adult 96.8
Male 96.8
Man 96.8
Crowd 95
Person 93.6
Adult 93.6
Male 93.6
Man 93.6
Person 93.5
Adult 93.5
Male 93.5
Man 93.5
Person 93.1
Adult 93.1
Male 93.1
Man 93.1
Person 92.6
Adult 92.6
Male 92.6
Man 92.6
Person 91
Adult 91
Male 91
Man 91
Person 89.8
Hat 89.7
Face 89.4
Head 89.4
Person 88.1
Adult 88.1
Male 88.1
Man 88.1
Person 86.8
Person 86.4
Person 85.8
Hat 83.9
Hat 83.4
Person 82.9
Adult 82.9
Male 82.9
Man 82.9
Person 81.4
Person 80.4
Person 78.5
Person 78.2
Person 78.1
Hat 75.6
Person 74.5
Hat 74.3
Hat 72.9
Person 72.8
Person 71.4
Person 71.1
Person 71
Hat 70
Hat 69.4
Person 68.8
Person 68.4
Person 64.2
Person 63.1
Person 62.3
Person 61.9
Person 61.5
Person 61.1
Person 60.2
Hat 59.5
Person 58
Coat 57.9
Person 56.6
Hat 56.4
Hat 56.1
Audience 55.4

Clarifai
created on 2018-05-10

people 100
many 99.9
veil 99.7
group together 99.7
group 99.5
adult 98.6
crowd 98.4
man 98.3
lid 97.2
wear 97.2
spectator 96.1
leader 96
outfit 95.5
audience 95
uniform 94.8
military 94.2
fedora 93.9
administration 93.8
baseball 92.3
war 91.9

Imagga
created on 2023-10-07

cowboy hat 100
hat 100
headdress 99.8
clothing 61.2
covering 34
consumer goods 33.4
money 17.9
currency 16.1
cash 15.5
travel 15.5
business 14.6
coins 14.5
bank 14.3
landscape 14.1
banking 13.8
finance 13.5
many 12.9
group 12.9
coin 12.4
water 12
beach 11.8
investment 11
sea 10.9
coast 10.8
wealth 9.9
vacation 9.8
market 9.8
pattern 9.6
row 9.3
summer 9
financial 8.9
success 8.8
sand 8.7
treasure 8.7
change 8.6
holiday 8.6
close 8.6
savings 8.4
city 8.3
sky 8.3
tourism 8.2
animal 8.1
closeup 8.1
silver 7.9
pay 7.7
texture 7.6
ocean 7.5
rich 7.4
bird 7.4
shore 7.4
food 7.3
sun 7.2
metal 7.2
color 7.2

Google
created on 2018-05-10

black and white 88.4
crowd 74.4
monochrome photography 72.3
troop 72.1
militia 68.6
monochrome 68.1
staff 52.9

Microsoft
created on 2018-05-10

person 99.1
posing 45.1
crowd 33.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 89.7%
Confused 6.7%
Surprised 6.4%
Fear 6.1%
Sad 2.3%
Happy 1.5%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 45-53
Gender Male, 96%
Calm 95.7%
Surprised 6.6%
Fear 5.9%
Sad 2.3%
Confused 1.4%
Angry 0.6%
Happy 0.6%
Disgusted 0.3%

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 89.3%
Surprised 6.7%
Fear 5.9%
Confused 4.7%
Sad 2.7%
Happy 1.7%
Angry 1.3%
Disgusted 0.3%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 95.1%
Surprised 6.3%
Fear 5.9%
Sad 4.1%
Confused 0.1%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 56.6%
Sad 37.9%
Happy 8.7%
Confused 7.6%
Surprised 7.3%
Fear 6%
Angry 0.9%
Disgusted 0.7%

AWS Rekognition

Age 23-33
Gender Male, 100%
Sad 99.9%
Calm 14.6%
Confused 7.1%
Surprised 6.5%
Fear 6%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-31
Gender Female, 77%
Sad 90.2%
Confused 41%
Calm 12.1%
Surprised 6.9%
Fear 6.1%
Disgusted 1.8%
Angry 0.7%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 93.4%
Surprised 6.8%
Fear 5.9%
Confused 3.1%
Sad 2.4%
Angry 1.1%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 10-18
Gender Male, 94.6%
Sad 99.9%
Happy 11.2%
Surprised 7.7%
Fear 6.5%
Calm 4%
Angry 2.7%
Disgusted 2.6%
Confused 1.4%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 96.5%
Surprised 6.3%
Fear 5.9%
Sad 3%
Angry 0.6%
Confused 0.2%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Happy 92.2%
Surprised 6.9%
Fear 6.1%
Sad 2.8%
Calm 1.9%
Disgusted 0.9%
Angry 0.7%
Confused 0.7%

AWS Rekognition

Age 45-51
Gender Male, 67.7%
Calm 45%
Happy 29%
Sad 10.9%
Surprised 7.7%
Fear 6.8%
Confused 4%
Angry 3.6%
Disgusted 1.5%

AWS Rekognition

Age 45-51
Gender Male, 100%
Confused 86%
Calm 7.2%
Surprised 6.6%
Fear 6%
Sad 2.8%
Angry 2.5%
Disgusted 1.3%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 98.4%
Sad 94.2%
Calm 42.3%
Confused 7.1%
Surprised 7%
Fear 6.1%
Angry 1%
Disgusted 0.9%
Happy 0.5%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Happy 65.1%
Calm 22.5%
Surprised 8.2%
Angry 6%
Fear 6%
Sad 2.5%
Disgusted 0.9%
Confused 0.7%

AWS Rekognition

Age 18-24
Gender Female, 73.4%
Sad 94.2%
Calm 41.8%
Surprised 7.4%
Fear 6.2%
Confused 4.3%
Angry 2.7%
Disgusted 1%
Happy 1%

AWS Rekognition

Age 41-49
Gender Male, 95.7%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.8%
Sad 70.9%
Calm 61.8%
Surprised 6.9%
Fear 6%
Happy 1.1%
Angry 0.9%
Confused 0.9%
Disgusted 0.7%

AWS Rekognition

Age 47-53
Gender Male, 100%
Sad 85.6%
Calm 44.9%
Confused 11.5%
Surprised 6.6%
Fear 6.1%
Angry 2.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 66.9%
Sad 32.7%
Surprised 6.9%
Fear 6.1%
Happy 4.9%
Confused 1.8%
Angry 1.8%
Disgusted 0.9%

AWS Rekognition

Age 24-34
Gender Female, 58.2%
Sad 96.8%
Calm 16.2%
Angry 9.8%
Fear 8.6%
Surprised 7.5%
Happy 6.7%
Confused 5.2%
Disgusted 3%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 98.4%
Calm 74%
Confused 8.8%
Fear 6.7%
Surprised 6.7%
Sad 5.4%
Happy 3.9%
Disgusted 2.2%
Angry 1.4%

AWS Rekognition

Age 21-29
Gender Male, 81.6%
Sad 99.8%
Surprised 8.6%
Happy 8.1%
Fear 7.2%
Confused 5.3%
Calm 4.4%
Disgusted 2.9%
Angry 0.8%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Sad 66.4%
Calm 24.6%
Surprised 14%
Confused 10.7%
Happy 9.2%
Angry 8.6%
Fear 7%
Disgusted 2.3%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 64.6%
Sad 35.1%
Surprised 6.9%
Fear 6.3%
Disgusted 3.7%
Confused 3.4%
Angry 2.1%
Happy 1.3%

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Calm 78.8%
Fear 7.4%
Surprised 7.4%
Sad 4.2%
Angry 3.4%
Happy 3.1%
Confused 2.7%
Disgusted 1.4%

AWS Rekognition

Age 39-47
Gender Male, 99%
Calm 27.5%
Confused 27.5%
Disgusted 23.9%
Surprised 9.5%
Fear 7%
Sad 5.3%
Happy 4%
Angry 2.5%

AWS Rekognition

Age 29-39
Gender Male, 96.5%
Calm 85.2%
Surprised 6.5%
Fear 6%
Sad 5.9%
Happy 2.9%
Confused 2.8%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Angry 0.1%
Confused 0%
Happy 0%
Calm 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Sad 85.4%
Calm 51.5%
Surprised 7.1%
Fear 6.2%
Disgusted 3.9%
Angry 1.2%
Confused 0.9%
Happy 0.8%

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 41.4%
Sad 32.2%
Calm 16%
Surprised 10.9%
Fear 6.6%
Confused 6.4%
Angry 3.5%
Disgusted 2.3%

AWS Rekognition

Age 20-28
Gender Male, 88.7%
Fear 91.5%
Calm 13.4%
Surprised 7.2%
Happy 5.8%
Sad 2.5%
Disgusted 0.8%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Male, 87.5%
Happy 66.2%
Calm 12.5%
Confused 10.5%
Fear 7.1%
Surprised 7%
Sad 3.1%
Disgusted 2.9%
Angry 0.8%

AWS Rekognition

Age 22-30
Gender Female, 73%
Calm 53.2%
Surprised 13.9%
Happy 12.4%
Sad 9.5%
Fear 6.4%
Confused 5.9%
Angry 3.2%
Disgusted 2.7%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Adult 96.8%
Male 96.8%
Man 96.8%
Hat 89.7%

Text analysis

Amazon

UNION
Chair
R