Human Generated Data

Title

Untitled (cockfight, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5156

Human Generated Data

Title

Untitled (cockfight, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5156

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 100
Crowd 99.7
Person 97.2
Adult 97.2
Male 97.2
Man 97.2
Person 97
Person 96.5
Adult 96.5
Male 96.5
Man 96.5
Person 95.9
Baby 95.9
Person 95.1
Adult 95.1
Bride 95.1
Female 95.1
Wedding 95.1
Woman 95.1
Person 94.3
Adult 94.3
Male 94.3
Man 94.3
Person 94.3
Person 93.8
Person 93.5
Person 91.5
Adult 91.5
Bride 91.5
Female 91.5
Woman 91.5
Person 91.1
Person 90
Adult 90
Bride 90
Female 90
Woman 90
Person 89.7
Person 89.3
Person 87.6
Person 87.3
Face 87.1
Head 87.1
Person 86.3
Person 85.1
Person 84.9
Audience 84.9
Person 84.8
Person 84.2
Person 82.9
Person 82.2
Person 81.7
Person 77.9
Clothing 75.8
Hat 75.8
Person 75.6
Person 75.4
Person 74.4
Person 71.4
Person 71.2
Person 70.2
Person 67.6
Person 67.1
Person 65.5
Person 65
Person 61.1
Person 60.1
Person 60
Person 56.5
Architecture 56.3
Building 56.3
Factory 56.3
Baseball Cap 56
Cap 56
Back 55.7
Body Part 55.7
Concert 55.4
Person 55.4
Manufacturing 55.4
Outdoors 55.1

Clarifai
created on 2018-05-10

people 100
many 99.7
crowd 99.1
group 98.8
group together 95.1
military 94.5
man 93.8
war 93.3
adult 93
audience 92.4
administration 91.5
child 91.5
woman 89
soldier 87.7
spectator 86.5
leader 84.2
boy 83.7
recreation 82
uniform 77.9
skirmish 76.4

Imagga
created on 2023-10-06

groom 31.7
statue 25.2
spectator 19
people 19
sky 18.5
person 17.6
man 16.8
bride 16.6
old 16
fan 15.6
travel 15.5
city 15
architecture 14.8
sculpture 14.5
wedding 13.8
park 13.4
stone 13
religion 12.5
love 11.8
follower 11.8
outdoor 11.5
tourist 11.4
married 10.5
couple 10.4
photographer 10.3
summer 10.3
metropolitan 10.2
happy 10
male 10
tourism 9.9
marriage 9.5
happiness 9.4
outdoors 9.1
vacation 9
art 8.6
religious 8.4
monument 8.4
building 8.3
landmark 8.1
new 8.1
bouquet 8.1
rock 7.8
ancient 7.8
two 7.6
life 7.5
landscape 7.4
symbol 7.4
church 7.4
water 7.3
dress 7.2
adult 7.2
history 7.2
family 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 97
window 83
people 81.9
group 79.6
crowd 30.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Confused 94.1%
Surprised 7.4%
Fear 6.6%
Sad 2.3%
Angry 0.9%
Disgusted 0.3%
Calm 0.2%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 97.5%
Calm 68.3%
Happy 17.2%
Fear 9%
Surprised 6.7%
Angry 5.2%
Sad 2.4%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 22-30
Gender Female, 82.9%
Calm 87.4%
Surprised 8.9%
Fear 6.8%
Happy 2.9%
Sad 2.4%
Angry 0.9%
Disgusted 0.8%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 80.2%
Calm 45.8%
Fear 39.6%
Sad 12.4%
Surprised 6.9%
Angry 2.7%
Confused 1.1%
Disgusted 0.6%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Female, 99.1%
Happy 89.6%
Surprised 7.5%
Fear 6.8%
Sad 2.7%
Confused 1.5%
Angry 1.2%
Disgusted 1.1%
Calm 0.6%

AWS Rekognition

Age 21-29
Gender Male, 98.7%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Female, 99.2%
Surprised 38.2%
Calm 27.3%
Disgusted 15.8%
Happy 10.4%
Sad 8.9%
Fear 7%
Angry 4.3%
Confused 3.1%

AWS Rekognition

Age 6-16
Gender Male, 58.7%
Sad 96.8%
Calm 39.1%
Surprised 6.5%
Fear 6.1%
Confused 3.6%
Happy 2.7%
Angry 2.3%
Disgusted 0.8%

AWS Rekognition

Age 18-26
Gender Male, 74.5%
Sad 95.8%
Calm 45%
Surprised 7.2%
Fear 6.3%
Angry 1.8%
Happy 0.7%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 19-27
Gender Female, 87.3%
Sad 99.9%
Calm 18.6%
Surprised 6.5%
Fear 6%
Happy 1%
Disgusted 0.4%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 90.1%
Sad 99.2%
Calm 28.9%
Surprised 6.7%
Fear 6.5%
Disgusted 3.3%
Confused 2.7%
Happy 1.7%
Angry 0.7%

AWS Rekognition

Age 18-24
Gender Female, 53.3%
Calm 72.5%
Sad 47.4%
Surprised 6.4%
Fear 5.9%
Confused 0.4%
Happy 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 77.7%
Happy 57.7%
Fear 12.1%
Sad 11.9%
Calm 11.7%
Surprised 6.7%
Angry 2.6%
Confused 1.5%
Disgusted 0.9%

AWS Rekognition

Age 23-31
Gender Male, 76.1%
Sad 90.6%
Confused 21.7%
Surprised 14.6%
Happy 10.1%
Fear 8%
Calm 7.5%
Angry 1.2%
Disgusted 1.1%

AWS Rekognition

Age 16-22
Gender Male, 96.4%
Angry 27.1%
Surprised 26%
Calm 15.9%
Happy 11.5%
Disgusted 8.8%
Sad 7.6%
Confused 6.6%
Fear 6.5%

AWS Rekognition

Age 23-31
Gender Female, 79%
Happy 95.4%
Surprised 6.4%
Fear 6.1%
Calm 2.9%
Sad 2.3%
Angry 0.3%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Female, 88.7%
Calm 88.2%
Surprised 6.6%
Fear 6%
Happy 5.1%
Sad 4.4%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Female, 60%
Calm 40.6%
Sad 39.1%
Surprised 13.7%
Confused 12.5%
Fear 6.5%
Happy 5.3%
Angry 3.9%
Disgusted 2.4%

AWS Rekognition

Age 23-31
Gender Male, 85%
Calm 74.6%
Sad 17.9%
Surprised 6.9%
Fear 6%
Confused 4.9%
Happy 1%
Disgusted 1%
Angry 0.8%

AWS Rekognition

Age 31-41
Gender Female, 87.6%
Surprised 99.1%
Disgusted 7.7%
Fear 6.1%
Calm 2.7%
Sad 2.3%
Happy 2.1%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 19-27
Gender Female, 65.3%
Sad 90%
Calm 31%
Confused 16%
Fear 7%
Surprised 6.9%
Angry 3.2%
Disgusted 2.1%
Happy 1.6%

AWS Rekognition

Age 16-24
Gender Female, 61.3%
Calm 56.5%
Sad 46.7%
Surprised 10.2%
Fear 6.9%
Happy 3.4%
Confused 2.8%
Disgusted 1.4%
Angry 1.3%

AWS Rekognition

Age 22-30
Gender Male, 98.9%
Sad 100%
Surprised 7.9%
Calm 7.4%
Fear 6.2%
Confused 2.9%
Angry 1.6%
Disgusted 1.2%
Happy 0.5%

AWS Rekognition

Age 7-17
Gender Female, 93.1%
Sad 78.3%
Calm 48.1%
Fear 6.7%
Surprised 6.6%
Happy 6.4%
Angry 3.1%
Disgusted 3.1%
Confused 0.9%

AWS Rekognition

Age 19-27
Gender Male, 98.3%
Calm 91.2%
Surprised 7.5%
Fear 6.1%
Sad 3.3%
Confused 1.7%
Happy 0.5%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 52-60
Gender Male, 88.7%
Calm 56.3%
Sad 19.8%
Confused 9.4%
Happy 8.5%
Surprised 7.9%
Fear 6.4%
Angry 2.3%
Disgusted 2.1%

AWS Rekognition

Age 11-19
Gender Male, 88.8%
Calm 94.8%
Surprised 6.3%
Fear 6%
Sad 3%
Happy 1.6%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Male, 95.2%
Sad 99.3%
Calm 29.6%
Confused 6.8%
Surprised 6.6%
Fear 5.9%
Angry 1.2%
Disgusted 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%
Adult 97.2%
Male 97.2%
Man 97.2%
Baby 95.9%
Bride 95.1%
Female 95.1%
Woman 95.1%