Human Generated Data

Title

Untitled (cockfight, Bali)
Date

February 2, 1960-February 17, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5157

Human Generated Data

Title

Untitled (cockfight, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5157

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Crowd 99.1
People 94.6
Person 93.6
Person 93.4
Person 92.7
Person 92.4
Person 92
Face 90.9
Head 90.9
Person 90.1
Person 89.4
Person 89.4
Clothing 89.2
Hat 89.2
Person 89
Audience 88.6
Person 88.5
Person 88.4
Adult 88.4
Female 88.4
Woman 88.4
Person 88.1
Person 87.9
Person 87.9
Person 87.3
Person 85
Person 84.3
Person 84.1
Person 83.6
Person 82.7
Bus Stop 82.4
Outdoors 82.4
Person 82.2
Person 81.2
Person 81.2
Person 78.2
Person 78
Person 77.8
Person 75.1
Person 74.2
Person 73.6
Person 71.9
Person 71
Person 67.5
Person 66.4
Person 65.1
Person 63.5
Person 62.9
Person 61.8
Person 61.2
Person 56.9
Architecture 55.5
Building 55.5
Shelter 55.5

Clarifai
created on 2018-05-10

people 100
many 99.8
crowd 99.7
group 99.2
audience 99.1
group together 98.6
spectator 95.4
man 95.2
adult 93.3
music 91.6
woman 88.2
administration 86.3
wear 82.6
recreation 81.2
child 80.4
leader 79.3
concert 78.4
boy 78.2
military 75.2
sports fan 74.8

Imagga
created on 2023-10-05

greenhouse 100
building 88.6
structure 74.2
architecture 21.1
man 20.1
school 15.4
people 15
city 14.9
sky 14.6
adult 13.6
urban 13.1
modern 12.6
statue 12.6
male 12
business 11.5
travel 10.5
person 10.5
old 10.4
men 10.3
construction 10.2
outdoors 9.7
monument 9.3
spectator 9.2
house 9.2
history 8.9
home 8.8
sculpture 8.6
place 8.4
protection 8.2
day 7.8
fountain 7.7
plant 7.5
street 7.3
water 7.3
danger 7.3
work 7.3
interior 7.1

Google
created on 2018-05-10

black and white 84.8
crowd 76.3
monochrome photography 59.2
history 56.5
recreation 54.6
monochrome 54.4
stock photography 51.8

Microsoft
created on 2018-05-10

person 95
people 65.9
crowd 62.5
group 59.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 87.7%
Calm 51%
Surprised 20.4%
Fear 16.4%
Happy 6.2%
Sad 4.4%
Angry 2.6%
Disgusted 1.4%
Confused 1%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Angry 52.8%
Calm 31.7%
Sad 10.3%
Surprised 6.9%
Fear 6.1%
Confused 1.4%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 97.6%
Calm 65.6%
Surprised 38.7%
Fear 6.3%
Confused 3.6%
Sad 2.6%
Happy 1%
Angry 0.9%
Disgusted 0.4%

AWS Rekognition

Age 16-24
Gender Male, 80.9%
Calm 72.4%
Surprised 13.8%
Sad 10.8%
Fear 6.8%
Happy 0.9%
Angry 0.9%
Disgusted 0.8%
Confused 0.5%

AWS Rekognition

Age 37-45
Gender Female, 81.9%
Confused 59.3%
Sad 15.6%
Disgusted 13.7%
Surprised 7.5%
Fear 6.8%
Calm 3.4%
Angry 3.4%
Happy 0.8%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Fear 49.8%
Calm 21.2%
Surprised 18.1%
Happy 8%
Angry 5.3%
Disgusted 4.2%
Sad 3.6%
Confused 2.4%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Happy 94.3%
Surprised 6.9%
Fear 6.6%
Sad 2.2%
Calm 1.3%
Disgusted 0.7%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 92.4%
Sad 100%
Calm 8.7%
Surprised 6.4%
Fear 6%
Angry 5.1%
Confused 3%
Disgusted 1.4%
Happy 1%

AWS Rekognition

Age 33-41
Gender Male, 99.7%
Happy 89.4%
Surprised 8.8%
Fear 6.5%
Sad 2.4%
Angry 1.3%
Calm 1%
Disgusted 1%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Female, 93%
Angry 50.9%
Happy 38.3%
Fear 7.1%
Surprised 6.7%
Calm 4.5%
Sad 2.7%
Disgusted 0.8%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Male, 61.5%
Calm 69.4%
Happy 9.2%
Fear 8.4%
Surprised 7.5%
Sad 5.5%
Disgusted 2.7%
Confused 2.4%
Angry 1.6%

AWS Rekognition

Age 22-30
Gender Male, 94%
Fear 96.7%
Surprised 9.4%
Sad 2.5%
Calm 0.8%
Confused 0.5%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 86.7%
Sad 99.3%
Confused 23.9%
Surprised 8%
Fear 6.2%
Angry 4.7%
Disgusted 4.1%
Calm 1.2%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Male, 60.1%
Calm 79.7%
Surprised 10.6%
Fear 6.5%
Disgusted 4.9%
Sad 3%
Angry 2.3%
Happy 1.4%
Confused 1.1%

AWS Rekognition

Age 27-37
Gender Male, 88.2%
Sad 100%
Calm 10.8%
Surprised 6.8%
Fear 6.4%
Confused 1.5%
Happy 1.4%
Angry 0.8%
Disgusted 0.5%

AWS Rekognition

Age 4-10
Gender Female, 95.2%
Happy 51.9%
Calm 45%
Surprised 6.4%
Fear 6.1%
Sad 2.4%
Confused 0.6%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Male, 89.8%
Happy 98.8%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.7%
Disgusted 0.1%
Calm 0%
Confused 0%

AWS Rekognition

Age 25-35
Gender Female, 93%
Happy 24.9%
Surprised 22.1%
Fear 16%
Sad 15.5%
Calm 8.6%
Angry 8.5%
Disgusted 5.9%
Confused 3.8%

AWS Rekognition

Age 57-65
Gender Female, 99%
Calm 77.5%
Surprised 14.7%
Fear 6.1%
Sad 4.5%
Angry 3.7%
Happy 1%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 18-26
Gender Male, 81.5%
Sad 97.1%
Calm 27.9%
Fear 12.6%
Surprised 8.4%
Angry 1.6%
Disgusted 1.3%
Happy 1.1%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Male, 99.4%
Calm 99.2%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 97.1%
Calm 60.8%
Sad 45.9%
Happy 9.1%
Surprised 6.6%
Fear 6%
Confused 2.2%
Angry 1.1%
Disgusted 0.3%

AWS Rekognition

Age 19-27
Gender Female, 94.3%
Sad 68.9%
Calm 65.4%
Surprised 6.4%
Fear 5.9%
Happy 1%
Disgusted 0.4%
Angry 0.3%
Confused 0.1%

AWS Rekognition

Age 27-37
Gender Female, 51.1%
Calm 92.9%
Surprised 6.4%
Fear 5.9%
Sad 4.2%
Confused 0.7%
Angry 0.5%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Female, 86.2%
Calm 92.1%
Surprised 6.4%
Fear 6%
Sad 4.1%
Confused 1.2%
Angry 0.8%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 87.7%
Calm 92%
Surprised 6.6%
Fear 6%
Happy 3%
Sad 2.5%
Angry 1.5%
Disgusted 1.1%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 95.5%
Sad 100%
Calm 12.6%
Surprised 6.3%
Fear 5.9%
Angry 1.2%
Confused 0.3%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 59.6%
Calm 89.1%
Surprised 9.1%
Fear 6%
Sad 2.7%
Angry 1.8%
Happy 1.3%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Calm 75.8%
Sad 9%
Fear 7.1%
Surprised 6.9%
Confused 5.8%
Happy 2.3%
Disgusted 1.2%
Angry 0.4%

AWS Rekognition

Age 23-31
Gender Male, 83.7%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 23-33
Gender Female, 90.5%
Fear 55.6%
Sad 34.3%
Calm 11.6%
Surprised 8.1%
Disgusted 7.3%
Happy 7%
Angry 3.3%
Confused 0.8%

AWS Rekognition

Age 28-38
Gender Female, 62.4%
Surprised 94.3%
Calm 31%
Fear 6.2%
Sad 2.4%
Confused 1.2%
Disgusted 1.1%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 16-22
Gender Male, 54.3%
Calm 59.7%
Sad 20.9%
Fear 8.2%
Surprised 7.1%
Angry 5.8%
Disgusted 3.8%
Happy 3.5%
Confused 2.9%

AWS Rekognition

Age 18-24
Gender Male, 97.6%
Happy 35.1%
Calm 33.1%
Angry 19.4%
Surprised 7.4%
Fear 6.1%
Sad 4.2%
Confused 3.7%
Disgusted 1%

AWS Rekognition

Age 19-27
Gender Male, 99.1%
Sad 99%
Calm 38.9%
Surprised 6.6%
Fear 5.9%
Confused 0.8%
Angry 0.4%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 97.5%
Sad 99.4%
Calm 36.6%
Surprised 6.3%
Fear 5.9%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Male, 99.9%
Sad 74.1%
Confused 32.9%
Calm 27.6%
Surprised 6.5%
Fear 6.1%
Happy 1.9%
Disgusted 1.7%
Angry 0.5%

AWS Rekognition

Age 9-17
Gender Female, 95.5%
Sad 99.8%
Calm 13.1%
Confused 7.8%
Fear 7.1%
Surprised 7.1%
Angry 2.3%
Happy 1.3%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Female, 90.7%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.6%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 19-27
Gender Female, 62.8%
Sad 95.9%
Calm 38.3%
Surprised 6.5%
Fear 6.1%
Confused 5.9%
Happy 4.9%
Angry 0.7%
Disgusted 0.4%

AWS Rekognition

Age 6-16
Gender Female, 95.3%
Happy 43.9%
Sad 38.7%
Calm 21.5%
Surprised 6.9%
Confused 6.2%
Fear 6.1%
Angry 1.9%
Disgusted 1.2%

AWS Rekognition

Age 23-31
Gender Male, 72.8%
Happy 59%
Disgusted 10.4%
Confused 9.5%
Surprised 7.9%
Sad 7.1%
Fear 7%
Calm 4%
Angry 2.8%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Sad 79.7%
Calm 22.8%
Confused 18.1%
Disgusted 9.7%
Surprised 7.8%
Fear 6.4%
Happy 6%
Angry 3.1%

AWS Rekognition

Age 22-30
Gender Male, 56.5%
Calm 94.2%
Fear 6.5%
Surprised 6.4%
Sad 2.8%
Confused 0.9%
Happy 0.4%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 59%
Sad 99.6%
Calm 13.4%
Fear 11.7%
Happy 7.2%
Surprised 6.4%
Angry 1.1%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Female, 96.2%
Calm 67.1%
Happy 18.2%
Surprised 8%
Fear 6.3%
Disgusted 5.5%
Sad 2.8%
Angry 1.9%
Confused 1.1%

AWS Rekognition

Age 24-34
Gender Female, 99%
Surprised 65.7%
Happy 39.8%
Fear 7.7%
Calm 6.6%
Sad 3.7%
Angry 2.4%
Disgusted 2.2%
Confused 1.9%

AWS Rekognition

Age 21-29
Gender Female, 96.3%
Calm 72.6%
Fear 8.3%
Happy 7.6%
Surprised 6.8%
Sad 4.7%
Angry 3.8%
Confused 2.4%
Disgusted 1.2%

AWS Rekognition

Age 18-24
Gender Female, 67.4%
Calm 72.8%
Sad 26.8%
Surprised 7%
Fear 6.9%
Disgusted 1.9%
Angry 0.6%
Happy 0.6%
Confused 0.3%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Female
Woman
Person 93.6%
Person 93.4%
Person 92.7%
Person 92.4%
Person 92%
Person 90.1%
Person 89.4%
Person 89.4%
Person 89%
Person 88.5%
Person 88.4%
Person 88.1%
Person 87.9%
Person 87.9%
Person 87.3%
Person 85%
Person 84.3%
Person 84.1%
Person 83.6%
Person 82.7%
Person 82.2%
Person 81.2%
Person 81.2%
Person 78.2%
Person 78%
Person 77.8%
Person 75.1%
Person 74.2%
Person 73.6%
Person 71.9%
Person 71%
Person 67.5%
Person 66.4%
Person 65.1%
Person 63.5%
Person 62.9%
Person 61.8%
Person 61.2%
Person 56.9%
Adult 88.4%
Female 88.4%
Woman 88.4%