Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4246

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, United States Customs' House, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4246

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Audience 99.7
Human 99.7
Crowd 99.7
Person 99.2
Person 98.6
Person 98.4
Person 98.3
Person 97.8
Person 97.7
Person 97.2
Person 96.5
Person 96.4
Person 96.2
Person 94.6
Person 93.2
Person 83.6
Person 79.1
Person 75.5
Room 74.7
Indoors 74.7
Clothing 71.8
Apparel 71.8
Person 68.8
People 67.8
Person 64.5
Interior Design 60.8
Speech 60.8
Sailor Suit 56.5
Lecture 56.3
Face 55.9
Portrait 55.2
Photo 55.2
Photography 55.2
Person 42.6

Clarifai
created on 2023-10-25

people 100
group 99.7
uniform 98
many 97.9
military 97.9
adult 97.4
soldier 97.2
war 97.1
group together 96.9
wear 95.9
man 95.1
leader 95
portrait 94.2
memory 93.6
veil 93.1
child 90.7
military uniform 90.2
outfit 90.1
army 89.9
woman 88.8

Imagga
created on 2022-01-08

military uniform 100
uniform 100
clothing 72.6
consumer goods 50.7
covering 44.6
statue 37.1
sculpture 33.7
commodity 25.1
history 24.1
helmet 23.4
monument 22.4
old 20.9
religion 20.6
architecture 19.5
ancient 19
art 17.6
armor plate 17.3
travel 16.2
famous 15.8
city 15.8
landmark 15.3
historical 15
culture 14.5
people 14.5
stone 14.3
tourism 14
historic 13.7
antique 13
man 12.8
religious 12.2
marble 11.6
building 11
soldier 10.7
plate 10.7
vintage 9.9
church 9.2
worship 8.7
heritage 8.7
spirituality 8.6
god 8.6
temple 8.5
male 8.5
classic 8.3
memorial 7.9
fountain 7.8
army 7.8
faith 7.6
traditional 7.5
tourist 7.2
family 7.1
love 7.1

Google
created on 2022-01-08

Coat 91.4
Hat 90.1
Suit 83.6
Headgear 83.2
Fedora 79.6
Art 79
Font 76.6
Vintage clothing 75.2
Event 72.8
Sun hat 70.3
Room 69.2
History 65
Crew 62.3
Crowd 62.2
Stock photography 61.9
Monochrome 61.8
Collection 60.3
Blazer 56.1
Photo caption 54
Audience 54

Microsoft
created on 2022-01-08

clothing 98.7
person 98.4
human face 95.9
man 94.7
text 70.3
posing 44.2
concert band 10.3
crowd 2.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 81.3%
Confused 13.1%
Sad 2.1%
Angry 2%
Disgusted 0.5%
Surprised 0.5%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 11-19
Gender Female, 94%
Calm 84.6%
Angry 9.3%
Confused 4%
Sad 1.4%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 36-44
Gender Female, 95%
Calm 99.4%
Confused 0.4%
Sad 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 78.4%
Confused 10.1%
Sad 7.7%
Angry 1.2%
Fear 1.1%
Surprised 0.6%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 47-53
Gender Male, 97.1%
Calm 99.8%
Sad 0.1%
Angry 0%
Surprised 0%
Happy 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 85%
Sad 27.1%
Angry 25.8%
Confused 17.6%
Calm 17.5%
Disgusted 4.2%
Fear 3.9%
Surprised 2.3%
Happy 1.5%

AWS Rekognition

Age 42-50
Gender Female, 75.6%
Calm 71.7%
Confused 12.7%
Surprised 9.3%
Angry 2.9%
Sad 1.5%
Disgusted 0.7%
Fear 0.6%
Happy 0.5%

AWS Rekognition

Age 43-51
Gender Male, 92.5%
Calm 98.2%
Angry 1%
Sad 0.4%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Female, 60.5%
Calm 94.9%
Happy 1.6%
Angry 1.5%
Sad 1%
Surprised 0.4%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Male, 78.1%
Surprised 28.3%
Angry 26.1%
Calm 20.3%
Happy 18.6%
Sad 2.9%
Disgusted 1.9%
Fear 1.4%
Confused 0.5%

AWS Rekognition

Age 31-41
Gender Female, 53.7%
Calm 47.6%
Sad 24.4%
Angry 10.9%
Surprised 6.9%
Happy 3.2%
Confused 2.9%
Fear 2.8%
Disgusted 1.3%

AWS Rekognition

Age 21-29
Gender Male, 98.3%
Angry 59.8%
Calm 38.1%
Disgusted 0.6%
Surprised 0.4%
Sad 0.4%
Confused 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Sad 69.7%
Angry 17.9%
Happy 5.7%
Calm 4.6%
Disgusted 0.9%
Fear 0.5%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 38-46
Gender Male, 88%
Calm 73.8%
Angry 8.9%
Happy 6.8%
Surprised 4.2%
Sad 2.9%
Confused 1.6%
Fear 1.1%
Disgusted 0.7%

AWS Rekognition

Age 26-36
Gender Female, 97.5%
Happy 74.6%
Surprised 13.2%
Calm 7.1%
Angry 1.5%
Fear 1.2%
Sad 0.8%
Disgusted 0.7%
Confused 0.7%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 85%
Fear 7.6%
Sad 2.3%
Angry 1.3%
Happy 1.1%
Confused 1.1%
Surprised 0.9%
Disgusted 0.7%

AWS Rekognition

Age 33-41
Gender Male, 96.7%
Calm 94.7%
Sad 2.2%
Angry 1.7%
Surprised 0.5%
Confused 0.4%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 16-24
Gender Female, 96.5%
Happy 52.9%
Sad 14.6%
Surprised 10.5%
Angry 8.5%
Calm 5.1%
Fear 3.8%
Confused 2.9%
Disgusted 1.6%

AWS Rekognition

Age 42-50
Gender Female, 99.9%
Angry 32.9%
Calm 32.1%
Sad 25.9%
Happy 2.4%
Fear 2.2%
Surprised 1.9%
Confused 1.6%
Disgusted 1%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Calm 98.5%
Sad 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 97%
Calm 94.8%
Disgusted 4%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Sad 0.2%
Happy 0.2%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 99%
Calm 97.5%
Sad 1.3%
Angry 0.3%
Fear 0.3%
Happy 0.2%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Female, 70.7%
Angry 56.6%
Calm 12.6%
Sad 11.3%
Fear 5.5%
Happy 4.4%
Confused 4.1%
Surprised 3.6%
Disgusted 1.7%

AWS Rekognition

Age 16-24
Gender Female, 99.9%
Calm 96.4%
Angry 2.3%
Confused 0.4%
Surprised 0.3%
Sad 0.3%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 90%
Calm 95.3%
Fear 1.1%
Disgusted 0.7%
Happy 0.7%
Angry 0.6%
Confused 0.6%
Surprised 0.5%
Sad 0.4%

AWS Rekognition

Age 24-34
Gender Female, 58.7%
Calm 75%
Sad 11.4%
Angry 4.3%
Disgusted 3.1%
Confused 1.9%
Fear 1.8%
Happy 1.3%
Surprised 1.3%

AWS Rekognition

Age 25-35
Gender Female, 83.5%
Calm 39.8%
Angry 34.2%
Fear 11.4%
Surprised 7.3%
Disgusted 2.9%
Confused 1.8%
Sad 1.6%
Happy 1.1%

AWS Rekognition

Age 10-18
Gender Female, 99.9%
Angry 78.7%
Calm 9.4%
Sad 4.1%
Disgusted 1.9%
Confused 1.6%
Happy 1.6%
Fear 1.4%
Surprised 1.3%

AWS Rekognition

Age 29-39
Gender Female, 50.9%
Calm 83.5%
Sad 5.5%
Angry 3.1%
Happy 2.9%
Surprised 2%
Disgusted 1.1%
Fear 1%
Confused 0.9%

AWS Rekognition

Age 33-41
Gender Male, 98.8%
Calm 63.7%
Angry 9.8%
Sad 8.2%
Confused 7.2%
Disgusted 5.2%
Happy 4%
Surprised 1.1%
Fear 0.8%

AWS Rekognition

Age 16-22
Gender Male, 80.7%
Calm 21.1%
Confused 20%
Sad 17.1%
Fear 17%
Disgusted 16.4%
Happy 3.3%
Angry 3.2%
Surprised 2%

AWS Rekognition

Age 24-34
Gender Male, 99.3%
Calm 53%
Disgusted 15%
Surprised 8.8%
Confused 8.7%
Happy 7%
Fear 4.5%
Angry 1.9%
Sad 1.1%

AWS Rekognition

Age 23-33
Gender Male, 99.1%
Calm 77.7%
Angry 6.2%
Sad 5.8%
Confused 3.9%
Disgusted 2.2%
Happy 1.8%
Surprised 1.6%
Fear 0.8%

AWS Rekognition

Age 16-24
Gender Male, 99.4%
Fear 84.8%
Calm 11.3%
Sad 1.7%
Confused 0.5%
Angry 0.5%
Surprised 0.4%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Male, 52.7%
Calm 65.1%
Angry 9.2%
Surprised 8.5%
Sad 7%
Fear 4.9%
Confused 3.6%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 12-20
Gender Male, 86.3%
Happy 62.8%
Calm 17.8%
Confused 8.1%
Disgusted 3.2%
Surprised 2.6%
Sad 2.3%
Fear 1.9%
Angry 1.4%

AWS Rekognition

Age 25-35
Gender Female, 92.3%
Sad 41.5%
Calm 36.7%
Angry 5.9%
Confused 4.2%
Happy 3.3%
Fear 3%
Surprised 2.9%
Disgusted 2.5%

AWS Rekognition

Age 24-34
Gender Female, 90.5%
Calm 85.7%
Angry 9.9%
Sad 2%
Surprised 0.9%
Disgusted 0.4%
Happy 0.4%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 10-18
Gender Female, 56%
Angry 67.7%
Calm 27.4%
Disgusted 2.1%
Sad 0.9%
Surprised 0.6%
Confused 0.5%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Female, 94.2%
Calm 91.5%
Angry 4.9%
Sad 1.6%
Surprised 0.7%
Confused 0.5%
Disgusted 0.4%
Fear 0.3%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 97.1%
Angry 56.9%
Calm 29.9%
Sad 7.9%
Fear 1.6%
Confused 1.1%
Surprised 1.1%
Happy 0.9%
Disgusted 0.6%

AWS Rekognition

Age 30-40
Gender Female, 87.1%
Calm 98.2%
Angry 1.1%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 12-20
Gender Male, 74.2%
Calm 94%
Fear 2.2%
Surprised 1.1%
Angry 1.1%
Sad 0.7%
Confused 0.4%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 12-20
Gender Female, 92.6%
Sad 41.3%
Calm 40.9%
Angry 8.4%
Disgusted 3.4%
Happy 2.3%
Confused 1.9%
Fear 1%
Surprised 0.9%

AWS Rekognition

Age 29-39
Gender Male, 72.8%
Angry 93.2%
Calm 5.6%
Sad 0.6%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Female, 98.7%
Calm 74.9%
Angry 6.3%
Sad 5.3%
Surprised 4.5%
Confused 2.9%
Fear 2.4%
Happy 2.3%
Disgusted 1.5%

AWS Rekognition

Age 6-14
Gender Female, 72.3%
Calm 92.3%
Sad 2.3%
Angry 2%
Surprised 0.9%
Confused 0.7%
Happy 0.7%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 31-41
Gender Male, 96.8%
Calm 97.9%
Angry 0.7%
Sad 0.6%
Happy 0.5%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 84.5%
Calm 90.3%
Angry 8.2%
Sad 0.8%
Surprised 0.2%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 13-21
Gender Male, 93.9%
Calm 92.4%
Angry 5.3%
Sad 0.8%
Happy 0.7%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 13-21
Gender Female, 52.9%
Calm 90.2%
Angry 2.4%
Sad 2.4%
Happy 1.4%
Surprised 1.1%
Confused 0.9%
Fear 0.9%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Male, 62.9%
Calm 54.5%
Fear 13.4%
Sad 11%
Angry 5.9%
Disgusted 4.9%
Confused 4.9%
Happy 4.1%
Surprised 1.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 94%
Surprised 3.1%
Angry 0.9%
Sad 0.7%
Confused 0.5%
Happy 0.4%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 89.8%
Calm 68.6%
Angry 25.8%
Surprised 1.6%
Sad 1.5%
Happy 1.4%
Disgusted 0.4%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 22-30
Gender Male, 93%
Calm 66.9%
Sad 9.1%
Fear 6.5%
Surprised 4.7%
Angry 4.7%
Disgusted 3.6%
Confused 2.7%
Happy 1.9%

AWS Rekognition

Age 6-14
Gender Male, 96.2%
Calm 77.7%
Angry 8.2%
Disgusted 4.3%
Surprised 2.8%
Happy 2.7%
Sad 2%
Fear 1.3%
Confused 1%

AWS Rekognition

Age 23-31
Gender Male, 93%
Calm 57.5%
Angry 22.6%
Happy 5%
Confused 4.1%
Fear 3.7%
Surprised 3.3%
Sad 2.6%
Disgusted 1.3%

AWS Rekognition

Age 20-28
Gender Female, 99.8%
Calm 98.4%
Confused 0.4%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%
Fear 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 87.6%
Calm 93.7%
Angry 3.2%
Happy 1.1%
Sad 1%
Surprised 0.5%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 31-41
Gender Male, 64.8%
Calm 89%
Happy 2.6%
Sad 2.2%
Angry 2.2%
Confused 1.4%
Surprised 1.2%
Disgusted 1.1%
Fear 0.4%

AWS Rekognition

Age 19-27
Gender Male, 99.4%
Sad 33.8%
Calm 30%
Angry 21%
Fear 9.7%
Surprised 1.7%
Happy 1.6%
Confused 1.3%
Disgusted 1%

AWS Rekognition

Age 16-24
Gender Female, 82.5%
Calm 90.3%
Sad 3.4%
Angry 2.1%
Confused 1.5%
Fear 0.7%
Surprised 0.7%
Happy 0.7%
Disgusted 0.6%

AWS Rekognition

Age 14-22
Gender Female, 77.6%
Sad 41.9%
Calm 38.9%
Angry 9.8%
Happy 2.8%
Confused 2.6%
Fear 1.7%
Surprised 1.4%
Disgusted 1%

AWS Rekognition

Age 18-24
Gender Female, 59.4%
Calm 99.5%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Happy 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 95.7%
Calm 97.2%
Confused 0.7%
Disgusted 0.5%
Angry 0.5%
Surprised 0.5%
Happy 0.3%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.4%
Calm 89.5%
Angry 6.2%
Sad 1.4%
Disgusted 0.8%
Surprised 0.7%
Happy 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Female, 99.3%
Calm 60%
Angry 36.7%
Surprised 0.7%
Sad 0.7%
Happy 0.6%
Disgusted 0.5%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Female, 69%
Calm 99.9%
Sad 0%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Calm 97.3%
Angry 0.9%
Happy 0.8%
Sad 0.6%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 98.7%
Angry 91.2%
Calm 7.4%
Sad 0.9%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 40-48
Gender Female, 66.5%
Calm 75%
Angry 15.3%
Sad 7.6%
Fear 0.8%
Surprised 0.5%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 90.8%
Calm 89.1%
Sad 3.1%
Happy 3%
Angry 2.7%
Confused 0.9%
Surprised 0.5%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Calm 48.9%
Fear 14.4%
Sad 12.9%
Happy 11%
Surprised 5.4%
Angry 4.5%
Disgusted 1.7%
Confused 1.3%

AWS Rekognition

Age 21-29
Gender Male, 97.1%
Sad 54.6%
Calm 30.3%
Happy 6%
Angry 5.1%
Disgusted 2.4%
Surprised 0.7%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 14-22
Gender Female, 59.3%
Calm 96.1%
Angry 3.2%
Sad 0.5%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Text analysis

Amazon

INDUSTRIAL
UNION
-
b
- INJURA
INJURA

Google

日
寸
2
NORE INOUSRIAL UNIO 4日寸2
NORE
INOUSRIAL
UNIO
4