Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

Date

December 1933-March 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3147

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3147

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 99.8
Adult 97.9
Male 97.9
Man 97.9
Person 97.9
Adult 97.1
Male 97.1
Man 97.1
Person 97.1
Adult 96.3
Male 96.3
Man 96.3
Person 96.3
Person 95.3
People 94.9
Adult 94.8
Male 94.8
Man 94.8
Person 94.8
Face 94.3
Head 94.3
Person 93.5
Baby 93.5
Coat 93.2
Adult 91.6
Male 91.6
Man 91.6
Person 91.6
Person 89.5
Person 87.1
Person 87
Person 86.4
Crowd 86
Person 84.7
Person 84.2
Adult 84.1
Male 84.1
Man 84.1
Person 84.1
Person 79.8
Person 74.4
Hat 73.8
Hat 73.1
Adult 72.2
Male 72.2
Man 72.2
Person 72.2
Hat 70.9
Hat 68.2
Person 67.4
Person 66.2
Person 65.5
Person 61.1
Person 61.1
Hat 57.2
Accessories 55.2
Glasses 55.2

Clarifai
created on 2018-05-10

people 100
many 100
veil 100
group together 99.7
group 99.6
wear 99.2
lid 99.2
adult 99.2
man 99
uniform 98.5
fedora 98.4
crowd 98.3
leader 98.1
outfit 97.6
administration 97.2
baseball 96.3
military 96.1
spectator 95.4
one 94.6
audience 94.3

Imagga
created on 2023-10-06

cowboy hat 100
hat 100
headdress 100
clothing 77.2
consumer goods 39.8
covering 39.4
cowboy 16.7
person 15.3
people 14.5
old 13.9
man 13.4
happy 13.1
portrait 12.9
western 11.6
smile 10.7
face 10.6
fashion 10.5
boy 10.4
model 10.1
holiday 10
child 10
male 9.9
vacation 9.8
market 9.8
two 9.3
guy 9.2
hand 9.1
style 8.9
hair 8.7
love 8.7
cute 8.6
adult 8.4
shirt 8.4
tourism 8.2
outdoors 8.2
handsome 8
kid 8
celebration 8
travel 7.7
summer 7.7
senior 7.5
fun 7.5
one 7.5
water 7.3
black 7.2
posing 7.1
season 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 92.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 98.6%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Angry 0.2%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.4%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Male, 100%
Sad 68.5%
Calm 67.4%
Surprised 6.3%
Fear 5.9%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 90.4%
Surprised 10.3%
Fear 6%
Sad 2.5%
Confused 0.7%
Angry 0.5%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 42-50
Gender Male, 92.1%
Calm 56.6%
Sad 21%
Surprised 10.1%
Confused 10.1%
Fear 7.2%
Happy 2.8%
Angry 2.3%
Disgusted 1.4%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Calm 78.5%
Confused 12.5%
Surprised 8.5%
Fear 6%
Sad 3.5%
Happy 0.7%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 82.8%
Sad 11.5%
Surprised 6.4%
Fear 6%
Confused 2.8%
Angry 0.9%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 92.4%
Surprised 6.4%
Fear 5.9%
Confused 4.1%
Sad 3.1%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.1%
Calm 75.8%
Surprised 12.5%
Fear 7.3%
Sad 4.5%
Angry 3.2%
Confused 1.4%
Happy 1.1%
Disgusted 0.7%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Happy 42.4%
Calm 35.3%
Surprised 17.4%
Fear 6.4%
Sad 3%
Angry 2.1%
Confused 1.8%
Disgusted 1.4%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Sad 78.5%
Calm 32.9%
Happy 14.7%
Surprised 8.2%
Angry 6.5%
Fear 6.5%
Confused 3.7%
Disgusted 1.3%

AWS Rekognition

Age 26-36
Gender Male, 99%
Surprised 39.7%
Calm 36%
Confused 20.2%
Fear 6.3%
Sad 5.9%
Happy 5.1%
Disgusted 2.1%
Angry 1.6%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 97.3%
Surprised 6.7%
Fear 6.2%
Sad 2.3%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.6%
Sad 100%
Calm 8.5%
Fear 6.4%
Surprised 6.3%
Confused 0.7%
Happy 0.5%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Female, 98.2%
Calm 73.8%
Confused 16.3%
Happy 8.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Male, 97.5%
Calm 52.2%
Confused 12.2%
Surprised 12.2%
Angry 11.5%
Sad 9.5%
Fear 6.4%
Happy 1.9%
Disgusted 1.5%

AWS Rekognition

Age 16-24
Gender Male, 98.2%
Calm 51.1%
Happy 28.4%
Sad 8.7%
Surprised 6.5%
Fear 6.4%
Angry 5.3%
Confused 1.8%
Disgusted 1.1%

AWS Rekognition

Age 14-22
Gender Male, 99.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.1%
Angry 0%
Happy 0%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 97.9%
Male 97.9%
Man 97.9%
Person 97.9%
Baby 93.5%
Hat 73.8%
Glasses 55.2%

Categories