Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2461
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2461

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Sun Hat 99.8
Coat 99.5
Adult 97.8
Male 97.8
Man 97.8
Person 97.8
Adult 96.9
Male 96.9
Man 96.9
Person 96.9
Adult 96.6
Male 96.6
Man 96.6
Person 96.6
Adult 96.2
Male 96.2
Man 96.2
Person 96.2
People 96.1
Adult 95.9
Male 95.9
Man 95.9
Person 95.9
Crowd 95.4
Person 94.8
Person 93.7
Adult 93.6
Male 93.6
Man 93.6
Person 93.6
Adult 93.1
Male 93.1
Man 93.1
Person 93.1
Person 92.6
Face 92.4
Head 92.4
Adult 92.3
Male 92.3
Man 92.3
Person 92.3
Person 92.2
Person 90.2
Person 89.9
Person 88.3
Person 87.1
Baby 87.1
Person 85.3
Person 85.2
Person 85.1
Person 84.4
Person 81.9
Person 81.8
Person 80.9
Formal Wear 80.8
Suit 80.8
Person 79.3
Person 78.8
Person 78.3
Person 78.3
Person 77.9
Adult 77.8
Male 77.8
Man 77.8
Person 77.8
Person 77
Hat 76.6
Person 75.9
Person 73.5
Person 67.5
Person 65.5
Person 63.9
Person 61.6
Person 61.3
Person 61.1
Person 60.6
Hat 57
Audience 56.4
Person 56.3

Clarifai
created on 2018-05-10

people 99.9
many 99.9
group together 99.5
group 99.1
veil 99.1
man 98.3
crowd 98.3
adult 97.7
leader 97.4
spectator 96.6
administration 96.5
audience 96.5
wear 96
outfit 95.8
lid 95
fedora 94
military 93.8
uniform 93.6
chair 93.5
baseball 92.1

Imagga
created on 2023-10-07

academic gown 53.6
gown 43.3
clothing 35.5
outerwear 32.1
person 21.2
covering 19.6
consumer goods 18.8
people 18.4
business 17
group 16.9
travel 15.5
scholar 15.4
man 14.8
male 14.2
landscape 14.1
meeting 14.1
mortarboard 13.3
businessman 13.2
cap 12.8
intellectual 12.3
men 12
military uniform 11.7
spectator 11.5
room 11.2
work 11
uniform 10.9
city 10.8
office 10.4
businesswoman 10
tourism 9.9
audience 9.7
baron 9.7
classroom 9.6
row 9.3
shore 9.3
headdress 9.3
lake 9.1
summer 9
coast 9
outdoors 9
team 8.9
sky 8.9
conference 8.8
water 8.7
sea 8.6
holiday 8.6
animal 8.6
corporate 8.6
businesspeople 8.5
hall 8.5
old 8.3
town 8.3
event 8.3
many 8.3
vacation 8.2
happy 8.1
sun 8
seat 8
adult 7.9
life 7.9
student 7.9
scenic 7.9
architecture 7.8
executive 7.8
color 7.8
aerial 7.8
industry 7.7
beach 7.6
communication 7.5
house 7.5
bird 7.4
teamwork 7.4
building 7.4
island 7.3
new 7.3
mountain 7.1
together 7

Google
created on 2018-05-10

black and white 89.9
troop 85
militia 77.8
monochrome photography 75.9
soldier 73.2
monochrome 67.4
crowd 59.7
military 58.2
military person 57.4
army 57.4
war 55.5
stock photography 53.7
staff 53.4
crew 50.5
military organization 50.4
military officer 50.1

Microsoft
created on 2018-05-10

person 99.9
group 66.7
crowd 56
posing 50.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 92.4%
Surprised 7%
Fear 6.1%
Sad 2.7%
Confused 1.8%
Happy 1%
Angry 0.9%
Disgusted 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.3%
Sad 97.4%
Calm 46.3%
Surprised 6.4%
Fear 5.9%
Confused 0.6%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 38-46
Gender Male, 100%
Happy 94%
Surprised 6.3%
Fear 6%
Calm 3.6%
Sad 2.4%
Angry 0.4%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.5%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.3%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.4%
Calm 97.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 1.4%
Confused 0.5%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 85.9%
Surprised 7%
Fear 6.1%
Sad 4.1%
Happy 3.1%
Confused 1.7%
Angry 1.6%
Disgusted 1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 49.8%
Calm 27.8%
Surprised 12.7%
Fear 6.9%
Sad 5.5%
Angry 1.5%
Confused 1.3%
Disgusted 1.1%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 97.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 1.5%
Confused 0.4%
Angry 0.4%
Disgusted 0.1%

AWS Rekognition

Age 39-47
Gender Female, 63.3%
Calm 97.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 1.6%
Disgusted 0.4%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99.5%
Calm 90.5%
Surprised 6.4%
Happy 6.1%
Fear 6%
Sad 2.9%
Confused 0.4%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 72.6%
Happy 11.7%
Surprised 7.4%
Fear 6.3%
Confused 4.8%
Sad 3.9%
Angry 1.9%
Disgusted 1.3%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 89.5%
Surprised 6.5%
Fear 5.9%
Sad 5.2%
Confused 2.7%
Happy 0.4%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 28-38
Gender Male, 97.9%
Calm 97.9%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 81%
Sad 6.9%
Surprised 6.8%
Fear 6.2%
Happy 5.8%
Angry 1.3%
Confused 1.2%
Disgusted 0.4%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 71.3%
Sad 39.8%
Surprised 6.5%
Fear 6%
Confused 3.3%
Angry 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 92%
Surprised 6.7%
Fear 6%
Sad 3.9%
Confused 1.8%
Angry 0.4%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 97.6%
Surprised 6.4%
Fear 5.9%
Sad 2.6%
Angry 0.5%
Confused 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 48-54
Gender Female, 57.7%
Sad 100%
Confused 7.9%
Surprised 6.5%
Fear 5.9%
Calm 5.7%
Angry 0.9%
Disgusted 0.8%
Happy 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 97.5%
Surprised 6.3%
Fear 5.9%
Happy 2.3%
Sad 2.2%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Confused 37.7%
Calm 36.8%
Surprised 11.9%
Fear 6.4%
Angry 5.3%
Sad 4.7%
Happy 2.7%
Disgusted 2.1%

AWS Rekognition

Age 45-51
Gender Male, 98.8%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 48-56
Gender Male, 99.4%
Sad 78.5%
Calm 52.4%
Confused 7.6%
Surprised 6.6%
Fear 6.1%
Angry 1.1%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 47-53
Gender Male, 97.1%
Happy 61.3%
Surprised 14.5%
Calm 11.4%
Fear 7%
Sad 4.4%
Confused 3.5%
Angry 2.6%
Disgusted 2.5%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 95.2%
Surprised 6.7%
Fear 6%
Sad 2.4%
Angry 1.3%
Confused 1.1%
Happy 0.5%
Disgusted 0.2%

AWS Rekognition

Age 48-54
Gender Male, 100%
Sad 99.9%
Calm 25.8%
Surprised 6.3%
Fear 5.9%
Confused 0.1%
Angry 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 75.4%
Sad 11.6%
Surprised 7%
Angry 6.6%
Fear 6%
Confused 2%
Happy 1%
Disgusted 0.8%

AWS Rekognition

Age 42-50
Gender Male, 94.1%
Calm 96.7%
Surprised 7.3%
Fear 6%
Sad 2.2%
Confused 0.6%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Male, 100%
Sad 75.5%
Calm 35.2%
Happy 18.6%
Fear 7.5%
Surprised 7%
Angry 3.7%
Confused 1.6%
Disgusted 0.9%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Sad 44.1%
Happy 43.1%
Fear 13.2%
Calm 12.6%
Surprised 6.8%
Disgusted 1.8%
Angry 1.6%
Confused 1.5%

AWS Rekognition

Age 35-43
Gender Male, 95.3%
Calm 96%
Surprised 6.4%
Fear 5.9%
Sad 2.9%
Confused 1.3%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 99.1%
Calm 82.2%
Surprised 12.5%
Fear 6.1%
Disgusted 2.9%
Sad 2.5%
Angry 2.3%
Happy 1.3%
Confused 0.7%

AWS Rekognition

Age 18-24
Gender Male, 92.8%
Sad 99.1%
Fear 11.8%
Disgusted 8.4%
Calm 8%
Surprised 7.7%
Happy 4.2%
Angry 3.3%
Confused 2.4%

AWS Rekognition

Age 28-38
Gender Male, 79.3%
Calm 42.5%
Angry 23.8%
Confused 16.6%
Disgusted 8.1%
Surprised 6.9%
Fear 6.1%
Sad 5.1%
Happy 1%

AWS Rekognition

Age 25-35
Gender Male, 81.6%
Sad 100%
Surprised 6.6%
Fear 6.2%
Angry 4.4%
Calm 2.5%
Happy 1.1%
Disgusted 1%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.5%
Calm 91.9%
Surprised 6.9%
Fear 6.1%
Sad 4.2%
Happy 0.7%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Sad 95.5%
Calm 46.6%
Surprised 6.7%
Fear 6%
Angry 2.1%
Happy 0.9%
Confused 0.8%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Male, 72.6%
Sad 98.2%
Fear 17.3%
Surprised 9.3%
Angry 7.3%
Confused 6.1%
Calm 3.9%
Disgusted 2.9%
Happy 1.9%

AWS Rekognition

Age 22-30
Gender Male, 96%
Calm 86.8%
Surprised 6.7%
Fear 6.1%
Sad 5.7%
Happy 2.6%
Disgusted 1%
Angry 0.5%
Confused 0.5%

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 13
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 97.8%
Male 97.8%
Man 97.8%
Person 97.8%
Baby 87.1%
Suit 80.8%
Hat 76.6%

Text analysis

Amazon

WAGE