Human Generated Data

Title

Untitled (cockfight, Bali)
Date

February 2, 1960-February 17, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5161

Human Generated Data

Title

Untitled (cockfight, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5161

Machine Generated Data

Tags

Amazon
created on 2023-10-07

People 99.5
Person 98.7
Person 97.5
Adult 97.5
Male 97.5
Man 97.5
Person 96.4
Animal 96.2
Bird 96.2
Chicken 96.2
Fowl 96.2
Poultry 96.2
Person 94.6
Person 94.4
Person 91.2
Person 90.8
Crowd 90.7
Person 90.3
Person 90.1
Person 90.1
Person 90.1
Person 89.7
Person 86.8
Person 86.8
Person 86.4
Person 85.1
Face 83.8
Head 83.8
Person 83.4
Person 81.6
Person 80.2
Person 79.9
Person 79
Person 78.8
Person 75.7
Person 74.8
Person 74.5
Person 74.1
Person 71.6
Person 71
Person 69.5
Person 67
Person 66.6
Person 66
Person 65.4
Clothing 62.8
Hat 62.8
Audience 62.4
Person 62.3
Person 59.7
Person 59.2
Person 59.2
Person 57.3
Bull 57
Mammal 57
Bullfighter 56.4
Bullfighting 55.9

Clarifai
created on 2018-05-10

people 100
many 99.3
group together 99
adult 98.3
group 98.2
man 95
woman 94.5
child 90.3
spectator 90.2
several 89.6
wear 88.1
military 87.3
recreation 84.4
athlete 84.1
crowd 81.4
uniform 80
administration 79.9
sitting 75.7
sit 73.6
seat 72.9

Imagga
created on 2023-10-07

people 24
man 23.5
spectator 19.8
male 19.2
person 19
silhouette 16.5
couple 15.7
sunset 14.4
summer 14.1
beach 13.5
sky 13.4
adult 13.3
relaxation 12.5
happy 12.5
group 12.1
sitting 12
water 12
relax 11.8
lifestyle 11.6
business 11.5
together 11.4
life 11.3
travel 11.3
outdoors 11.2
men 11.2
sport 11
sea 10.9
black 10.9
leisure 10.8
outdoor 10.7
vacation 10.6
businessman 10.6
active 10.5
ocean 9.9
fun 9.7
friends 9.4
tourism 9.1
portrait 9
sun 8.8
scholar 8.7
boy 8.7
love 8.7
happiness 8.6
walking 8.5
old 8.4
freedom 8.2
landscape 8.2
team 8.1
night 8
building 8
holiday 7.9
day 7.8
dusk 7.6
kin 7.5
professional 7.5
alone 7.3
smiling 7.2
looking 7.2
history 7.1
romance 7.1
smile 7.1
mountain 7.1

Google
created on 2018-05-10

photograph 96.2
black 95.4
black and white 91.3
snapshot 81.8
photography 81.6
monochrome photography 79.2
sitting 76.4
monochrome 69.8
crowd 67.4
history 66.3
recreation 60.9
stock photography 56.7
human behavior 55.9
vintage clothing 51.3

Microsoft
created on 2018-05-10

person 97.1
people 85.7
black 65.8
white 63.7
group 62.3
old 57
crowd 41.1

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 98.5%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Female, 51.7%
Calm 27.3%
Happy 15.8%
Surprised 15%
Disgusted 13.9%
Fear 12.7%
Sad 7.6%
Confused 7%
Angry 2.8%

AWS Rekognition

Age 23-31
Gender Male, 59.4%
Calm 97%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 2.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 94.5%
Surprised 6.3%
Fear 5.9%
Sad 3.7%
Confused 0.9%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Female, 84.8%
Sad 100%
Surprised 6.6%
Fear 6.2%
Calm 3.8%
Happy 1.8%
Angry 0.6%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 20-28
Gender Female, 67%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 19-27
Gender Female, 97.9%
Calm 70.4%
Sad 10.6%
Surprised 9.7%
Fear 6.7%
Happy 5.7%
Confused 2%
Disgusted 1.3%
Angry 1.3%

AWS Rekognition

Age 41-49
Gender Male, 98.4%
Surprised 54.7%
Fear 23.4%
Calm 15%
Angry 11.7%
Disgusted 5.8%
Confused 5.6%
Sad 3.7%
Happy 0.8%

AWS Rekognition

Age 27-37
Gender Female, 77.8%
Calm 59%
Disgusted 14.2%
Surprised 7.7%
Sad 7.4%
Fear 6.6%
Angry 5.8%
Confused 5.7%
Happy 1.8%

AWS Rekognition

Age 24-34
Gender Male, 74.4%
Calm 94%
Surprised 6.4%
Fear 6%
Sad 2.7%
Happy 2%
Confused 0.8%
Angry 0.8%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Female, 92.8%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.4%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Male, 95.7%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.6%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Female, 50.2%
Sad 90.4%
Calm 37.6%
Fear 7.1%
Surprised 6.9%
Angry 5.7%
Confused 5.6%
Happy 2.8%
Disgusted 1.6%

AWS Rekognition

Age 22-30
Gender Male, 79.2%
Sad 54.9%
Calm 52.8%
Surprised 10.6%
Fear 8.4%
Confused 3.3%
Angry 1.5%
Disgusted 0.9%
Happy 0.9%

AWS Rekognition

Age 23-31
Gender Male, 99.2%
Calm 97%
Surprised 6.3%
Fear 5.9%
Sad 2.9%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Male, 69.6%
Angry 51.7%
Calm 13.2%
Confused 11%
Fear 9.6%
Surprised 8%
Sad 6.4%
Disgusted 4.1%
Happy 1.1%

AWS Rekognition

Age 4-10
Gender Male, 97.1%
Calm 45.1%
Sad 38.6%
Angry 17.8%
Surprised 7.8%
Fear 6.6%
Disgusted 4.4%
Confused 2.4%
Happy 2.3%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Surprised 98.7%
Fear 8.8%
Angry 6.5%
Calm 4%
Sad 2.2%
Disgusted 0.3%
Happy 0.3%
Confused 0.1%

AWS Rekognition

Age 16-24
Gender Female, 89.3%
Surprised 75.2%
Happy 19.9%
Sad 13.3%
Calm 10.3%
Fear 6.7%
Disgusted 4.5%
Confused 4%
Angry 1.3%

AWS Rekognition

Age 42-50
Gender Female, 69.1%
Sad 72.5%
Calm 32.4%
Angry 9.9%
Confused 8.6%
Happy 8.2%
Surprised 7.3%
Fear 6.8%
Disgusted 3.2%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Sad 99.3%
Confused 14.8%
Fear 14%
Surprised 7.4%
Calm 6%
Happy 1%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 18-26
Gender Male, 89.6%
Confused 37.9%
Surprised 26.9%
Sad 17.8%
Calm 12.2%
Happy 7%
Fear 6.5%
Angry 3%
Disgusted 2.5%

AWS Rekognition

Age 23-31
Gender Female, 86.7%
Calm 96.6%
Surprised 6.6%
Fear 6%
Sad 2.5%
Disgusted 0.4%
Happy 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 9-17
Gender Female, 54%
Sad 96.9%
Calm 33.8%
Fear 8.6%
Surprised 6.6%
Happy 4.1%
Angry 2.5%
Confused 1.6%
Disgusted 0.4%

AWS Rekognition

Age 2-10
Gender Female, 86.9%
Surprised 53.1%
Calm 40.4%
Fear 7.6%
Confused 7.2%
Happy 6.6%
Sad 4%
Angry 3%
Disgusted 1.5%

AWS Rekognition

Age 19-27
Gender Male, 50.1%
Calm 62.1%
Disgusted 11.9%
Surprised 10.1%
Fear 6.9%
Sad 6.6%
Angry 4.3%
Happy 2.6%
Confused 2.2%

AWS Rekognition

Age 22-30
Gender Female, 73.2%
Surprised 98.2%
Fear 8.1%
Happy 4%
Sad 3.7%
Calm 3.3%
Angry 2.9%
Confused 2%
Disgusted 1%

AWS Rekognition

Age 14-22
Gender Male, 65.1%
Calm 91.6%
Surprised 7.2%
Fear 6.2%
Sad 2.8%
Angry 1.6%
Disgusted 1%
Happy 0.8%
Confused 0.4%

AWS Rekognition

Age 18-24
Gender Female, 97.2%
Calm 53.7%
Surprised 32.9%
Sad 11%
Fear 7.6%
Happy 2.9%
Confused 1.5%
Angry 1.4%
Disgusted 1.2%

AWS Rekognition

Age 18-24
Gender Female, 52.1%
Calm 88%
Surprised 6.9%
Fear 6.2%
Sad 4.1%
Confused 2.3%
Angry 1.8%
Disgusted 0.7%
Happy 0.7%

AWS Rekognition

Age 34-42
Gender Female, 83.8%
Calm 62.4%
Confused 9.6%
Sad 9.1%
Surprised 8.1%
Fear 6.8%
Disgusted 5.4%
Happy 4.8%
Angry 1.7%

AWS Rekognition

Age 7-17
Gender Male, 97.6%
Fear 43%
Sad 37.2%
Calm 17.9%
Surprised 11.8%
Happy 3.8%
Confused 3.6%
Angry 3.5%
Disgusted 3%

AWS Rekognition

Age 6-12
Gender Female, 54.5%
Calm 88.4%
Surprised 6.6%
Fear 6%
Angry 4.4%
Sad 4.4%
Disgusted 0.4%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 47-53
Gender Male, 61.9%
Sad 97.3%
Calm 45.1%
Surprised 6.5%
Fear 6%
Angry 0.9%
Disgusted 0.7%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 90.7%
Happy 59.3%
Surprised 14.4%
Disgusted 8.5%
Angry 7%
Calm 6.7%
Fear 6.2%
Sad 5.2%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Male, 74.8%
Sad 100%
Calm 8.1%
Surprised 6.4%
Fear 6%
Confused 4.1%
Angry 0.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 84.2%
Calm 58.5%
Happy 28.3%
Surprised 6.7%
Fear 6.2%
Sad 6.1%
Confused 2.1%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 23-31
Gender Female, 51.8%
Sad 66.1%
Calm 49.9%
Disgusted 9.9%
Surprised 6.7%
Fear 6.3%
Happy 3.6%
Angry 2.2%
Confused 1%

AWS Rekognition

Age 1-7
Gender Female, 86.7%
Happy 83.5%
Fear 9.4%
Surprised 8.2%
Calm 2.5%
Sad 2.4%
Angry 1%
Disgusted 0.8%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Male, 63.7%
Calm 66%
Sad 16.9%
Happy 11%
Fear 7.1%
Surprised 6.4%
Confused 2.1%
Angry 1%
Disgusted 0.8%

AWS Rekognition

Age 21-29
Gender Female, 52.2%
Calm 86.5%
Fear 7.7%
Surprised 7%
Sad 3.5%
Angry 1.2%
Happy 1.1%
Confused 1.1%
Disgusted 0.8%

AWS Rekognition

Age 18-24
Gender Male, 97.5%
Calm 43.6%
Surprised 33.4%
Fear 14%
Angry 9.5%
Happy 4.3%
Sad 2.5%
Disgusted 2.1%
Confused 1.6%

AWS Rekognition

Age 21-29
Gender Male, 88.3%
Surprised 57%
Calm 53.7%
Fear 6.2%
Sad 4.7%
Happy 2.1%
Confused 1.9%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 10-18
Gender Male, 86%
Calm 69.9%
Sad 25.4%
Surprised 6.9%
Fear 6.2%
Confused 3.9%
Happy 2.7%
Angry 1.4%
Disgusted 0.8%

AWS Rekognition

Age 22-30
Gender Male, 62.1%
Calm 69.4%
Happy 28%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Disgusted 0.6%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Male, 96.5%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 13-21
Gender Male, 97.3%
Sad 93.2%
Calm 27.3%
Disgusted 20.8%
Surprised 6.6%
Fear 6.4%
Confused 2.7%
Happy 1.1%
Angry 0.9%

AWS Rekognition

Age 18-24
Gender Male, 74.1%
Sad 100%
Surprised 6.5%
Fear 6.4%
Calm 5.1%
Confused 3.4%
Happy 2.4%
Angry 1.6%
Disgusted 0.7%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Feature analysis

Amazon

Person
Adult
Male
Man
Chicken
Person 98.7%
Person 97.5%
Person 96.4%
Person 94.6%
Person 94.4%
Person 91.2%
Person 90.8%
Person 90.3%
Person 90.1%
Person 90.1%
Person 90.1%
Person 89.7%
Person 86.8%
Person 86.8%
Person 86.4%
Person 85.1%
Person 83.4%
Person 81.6%
Person 80.2%
Person 79.9%
Person 79%
Person 78.8%
Person 75.7%
Person 74.8%
Person 74.5%
Person 74.1%
Person 71.6%
Person 71%
Person 69.5%
Person 67%
Person 66.6%
Person 66%
Person 65.4%
Person 62.3%
Person 59.7%
Person 59.2%
Person 59.2%
Person 57.3%
Adult 97.5%
Male 97.5%
Man 97.5%
Chicken 96.2%