Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3156
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3156

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 100
People 99.9
Crowd 98.6
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 97.3
Adult 97.3
Male 97.3
Man 97.3
Person 97.2
Adult 97.2
Male 97.2
Man 97.2
Person 96.5
Person 95.7
Adult 95.7
Male 95.7
Man 95.7
Person 95
Adult 95
Male 95
Man 95
Face 93.3
Head 93.3
Person 93.2
Adult 93.2
Male 93.2
Man 93.2
Person 90.8
Person 89.9
Adult 89.9
Male 89.9
Man 89.9
Person 88.3
Person 85.9
Person 83.7
Person 82.6
Sun Hat 82.1
Person 79.1
Person 78.3
Person 78.2
Audience 77.9
Person 77.9
Person 77.8
Person 76.8
Person 76.7
Coat 76.6
Person 75.2
Person 67.4
Person 62.5
Person 61.9
Person 60.1
Person 57.9
Cap 57.4
Parade 55.4
Protest 55.4
Text 55

Clarifai
created on 2018-05-10

people 100
many 99.7
group 99.3
veil 99.1
group together 98.8
lid 98.3
adult 98.2
man 97.7
fedora 97.1
leader 97
wear 96.1
crowd 96
administration 95.7
outfit 93.5
military 93.2
spectator 93
woman 89.7
audience 88.3
one 85.5
recreation 85.3

Imagga
created on 2023-10-06

cowboy hat 96.1
hat 79.3
headdress 58
clothing 54.6
covering 33
consumer goods 32.4
military uniform 32.2
uniform 27.6
travel 17.6
tourism 16.5
landscape 14.9
man 14.1
sky 14
male 13.5
city 13.3
summer 12.2
people 11.7
animal 11.4
outdoors 11.2
old 11.1
person 10.5
sun 10.5
town 10.2
architecture 10.1
vacation 9.8
shore 9.3
building 8.9
water 8.7
lake 8.2
scenic 7.9
holiday 7.9
work 7.8
sea 7.8
color 7.8
outside 7.7
industry 7.7
stone 7.6
journey 7.5
house 7.5
happy 7.5
south 7.5
boat 7.4
group 7.2
looking 7.2
coast 7.2
history 7.2
rural 7

Google
created on 2018-05-10

troop 76.3
human behavior 76.3
military 74.4
crowd 68
soldier 57.4
army 55.3

Microsoft
created on 2018-05-10

person 99.3
white 64
crowd 52.8
old 52.6
posing 46.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 99.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 39-47
Gender Female, 86.7%
Calm 62%
Happy 29.5%
Surprised 6.4%
Fear 6%
Sad 4.8%
Disgusted 0.8%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 91.4%
Surprised 7%
Fear 6.2%
Sad 2.8%
Angry 2.5%
Happy 1%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Male, 99.5%
Happy 82.4%
Calm 8.7%
Surprised 6.7%
Fear 6%
Sad 3.3%
Angry 3.3%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Sad 96.8%
Fear 13%
Calm 12.2%
Confused 9.1%
Surprised 8.1%
Angry 6.1%
Happy 2.9%
Disgusted 2.7%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 91.4%
Surprised 6.5%
Fear 6.1%
Sad 4.4%
Disgusted 1.1%
Confused 0.7%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 96.9%
Surprised 6.7%
Fear 5.9%
Sad 2.2%
Confused 0.8%
Angry 0.6%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Male, 96.1%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 88.9%
Surprised 7%
Fear 6.2%
Happy 4.6%
Sad 2.4%
Angry 1.2%
Disgusted 1.2%
Confused 1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 88.1%
Sad 7.4%
Surprised 6.5%
Fear 5.9%
Angry 0.9%
Confused 0.8%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 29-39
Gender Female, 94.9%
Calm 57%
Happy 17.2%
Sad 8.2%
Fear 7%
Surprised 6.9%
Angry 5.1%
Confused 3.8%
Disgusted 3.1%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 95%
Surprised 6.7%
Fear 5.9%
Angry 3.3%
Sad 2.3%
Confused 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 97.4%
Calm 96%
Surprised 6.4%
Fear 5.9%
Sad 2.8%
Happy 1%
Disgusted 0.3%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Male, 96.9%
Calm 99.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Happy 0.3%
Disgusted 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 39-47
Gender Male, 97.9%
Calm 83.8%
Sad 8.8%
Surprised 6.6%
Fear 6%
Angry 3.1%
Confused 0.9%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 35-43
Gender Male, 100%
Sad 99.9%
Calm 17.7%
Surprised 6.3%
Fear 6%
Happy 2.8%
Angry 0.3%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 80.3%
Sad 69.3%
Calm 51.4%
Fear 9%
Surprised 6.6%
Happy 3.3%
Angry 3.2%
Disgusted 1.2%
Confused 0.9%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 96.6%
Surprised 6.8%
Fear 5.9%
Sad 2.4%
Disgusted 0.5%
Happy 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 41-49
Gender Male, 100%
Happy 90.2%
Surprised 6.6%
Fear 6%
Calm 3.6%
Sad 2.4%
Disgusted 2.1%
Confused 1.2%
Angry 1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Sad 99.9%
Calm 18.4%
Surprised 6.3%
Fear 6%
Happy 1.5%
Confused 0.6%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 98.2%
Surprised 6.4%
Fear 6%
Sad 2.3%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Male, 97.7%
Calm 96%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Angry 1.7%
Happy 0.7%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 16-22
Gender Male, 99.1%
Calm 70.3%
Sad 16.6%
Fear 7.8%
Surprised 6.9%
Confused 3.2%
Disgusted 2.7%
Happy 2.1%
Angry 0.3%

AWS Rekognition

Age 31-41
Gender Male, 87.5%
Confused 80%
Calm 13.5%
Surprised 6.4%
Fear 6%
Sad 4.3%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 54-62
Gender Male, 99.8%
Confused 42.8%
Calm 25.2%
Surprised 11.8%
Sad 10.1%
Happy 8.9%
Fear 6.1%
Disgusted 1.8%
Angry 1.2%

AWS Rekognition

Age 23-31
Gender Male, 88.9%
Calm 88%
Sad 8.1%
Surprised 6.4%
Fear 6%
Happy 1%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Female, 98.6%
Calm 81.5%
Surprised 8.4%
Fear 6.3%
Sad 4.1%
Happy 2.9%
Angry 2.9%
Disgusted 2%
Confused 1%

AWS Rekognition

Age 16-22
Gender Female, 82.7%
Calm 82%
Surprised 7.9%
Fear 7%
Happy 5.5%
Confused 3.2%
Sad 2.7%
Angry 1.1%
Disgusted 1%

AWS Rekognition

Age 14-22
Gender Male, 89.2%
Calm 93.5%
Surprised 6.3%
Fear 5.9%
Sad 4.5%
Happy 0.5%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 63.3%
Sad 97.8%
Calm 33.1%
Fear 8.6%
Surprised 6.6%
Happy 3%
Confused 1.6%
Angry 1.2%
Disgusted 1.1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 96.7%
Surprised 6.3%
Fear 5.9%
Sad 3.3%
Angry 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Sad 99.5%
Angry 19.8%
Calm 10.6%
Surprised 7.1%
Fear 6.4%
Happy 1.5%
Confused 1%
Disgusted 0.7%

AWS Rekognition

Age 19-27
Gender Female, 80.8%
Calm 83.7%
Surprised 6.5%
Happy 6%
Fear 5.9%
Confused 4.3%
Sad 2.8%
Angry 2.4%
Disgusted 1.2%

AWS Rekognition

Age 25-35
Gender Male, 86.9%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Male, 97.1%
Sad 99.8%
Calm 12.2%
Happy 11%
Surprised 6.7%
Fear 6.5%
Angry 1.9%
Confused 0.8%
Disgusted 0.5%

AWS Rekognition

Age 29-39
Gender Female, 89.6%
Sad 100%
Fear 7.9%
Calm 6.8%
Surprised 6.6%
Angry 3.3%
Happy 2.3%
Disgusted 1.3%
Confused 0.8%

AWS Rekognition

Age 27-37
Gender Male, 95.5%
Sad 88.4%
Calm 40%
Fear 10.5%
Surprised 6.8%
Angry 4.9%
Confused 1.9%
Disgusted 1.2%
Happy 0.8%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 84.1%
Sad 12.3%
Surprised 6.4%
Fear 5.9%
Angry 1.9%
Confused 0.4%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Male, 97.6%
Angry 88.8%
Surprised 6.5%
Fear 5.9%
Happy 5.1%
Sad 2.9%
Calm 2.1%
Confused 0.8%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Female, 97.9%
Calm 84.4%
Surprised 7.4%
Fear 7.1%
Sad 3.3%
Disgusted 2.3%
Angry 2.1%
Happy 1.6%
Confused 1.5%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Sad 100%
Surprised 6.4%
Fear 5.9%
Calm 2.7%
Happy 1.7%
Confused 1.6%
Angry 0.7%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0.3%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Adult 97.6%
Male 97.6%
Man 97.6%

Text analysis

Amazon

FOR
DEMAND
WORK
RELIEF
LEAGUE
WORKERS
UNEMPLOY
UNIO
WE
A
$13.000
WE WORK FOR A LA
IOAIS
MOSIS IOAIS
MOSIS
NOC.W.A
MAR
ONTINUE
LA
NOUSHA
LB
RAEPS
и
43
чз. 43
чз.
ARWA
adidas

Google

bu 13.000 NOCW
bu
13.000
NOCW