Human Generated Data

Title

Untitled (cockfight, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5155

Human Generated Data

Title

Untitled (cockfight, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5155

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 99.3
Person 99
Adult 99
Male 99
Man 99
Person 97
People 97
Person 94.9
Adult 94.9
Male 94.9
Man 94.9
Face 94.6
Head 94.6
Person 89.2
Photography 85.9
Portrait 85.9
Person 84.7
Person 82.7
Animal 80.2
Mammal 80.2
Person 80.1
Person 76.3
Crowd 74.7
Canine 67.3
Person 67
Pet 65.3
Person 65.3
Person 63.1
Dog 57.4
Hound 57.4
Audience 56.5
Person 56.5
Bullfighter 55.9
Bull 55.6

Clarifai
created on 2018-05-10

people 99.9
group 98.8
adult 97.4
man 95.9
woman 94.3
many 92.3
wear 91.9
group together 90.3
administration 87.6
child 87.6
leader 87.3
portrait 86.9
sit 86.5
facial expression 85.6
recreation 84.9
two 83.3
outfit 82.3
actor 81.9
actress 78.4
music 75.6

Imagga
created on 2023-10-06

man 47.7
male 41.3
couple 34.8
person 34.7
people 32.9
happy 29.4
businessman 28.2
smiling 25.3
spectator 24.6
men 24
business 23.7
senior 23.4
adult 22.4
portrait 22
love 20.5
elderly 20.1
fan 20
smile 19.2
old 18.8
handsome 18.7
together 17.5
businesspeople 17.1
office 16.9
mature 16.7
group 16.1
corporate 15.5
businesswoman 15.4
husband 15.4
follower 15.4
professional 15.3
team 15.2
executive 15.2
family 15.1
suit 15
colleagues 14.6
happiness 14.1
supporter 14
aged 13.6
women 13.4
meeting 13.2
sitting 12.9
older 12.6
work 12.6
lifestyle 12.3
teamwork 12.1
outdoors 11.9
retired 11.6
job 11.5
working 11.5
cheerful 11.4
face 11.4
grandfather 11.3
standing 11.3
looking 11.2
two 11
confident 10.9
attractive 10.5
marriage 10.4
wife 10.4
home 10.4
day 10.2
casual 10.2
communication 10.1
20s 10.1
father 10
businessmen 9.8
indoors 9.7
success 9.7
student 9.6
married 9.6
celebration 9.6
table 9.5
adults 9.5
manager 9.3
laptop 9.1
fun 9
romance 8.9
romantic 8.9
computer 8.8
affection 8.7
busy 8.7
talking 8.6
child 8.4
friendly 8.2
building 8.2
seniors 7.9
mother 7.8
discussion 7.8
outside 7.7
30s 7.7
tie 7.6
horizontal 7.5
friends 7.5
holding 7.4
occupation 7.3
indoor 7.3
medical 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99
outdoor 93.9
old 44.2
crowd 2.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 51.8%
Fear 82.9%
Surprised 31.3%
Disgusted 3.9%
Angry 3.1%
Calm 2.8%
Sad 2.5%
Confused 1.6%
Happy 0.6%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 59.6%
Sad 51.9%
Angry 9.4%
Surprised 6.6%
Fear 6.2%
Disgusted 1.3%
Confused 0.5%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 97.9%
Calm 89%
Surprised 7.4%
Fear 6.1%
Sad 4.3%
Confused 1.3%
Happy 1.2%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 24-34
Gender Male, 97%
Sad 99.8%
Calm 28.9%
Surprised 6.4%
Fear 5.9%
Confused 0.6%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 7-17
Gender Female, 71.5%
Calm 61.2%
Sad 17.9%
Surprised 8.1%
Fear 7.1%
Happy 6.4%
Disgusted 5.2%
Angry 3.5%
Confused 1.4%

AWS Rekognition

Age 19-27
Gender Female, 70.9%
Calm 88.3%
Surprised 7.2%
Fear 6.3%
Happy 3.3%
Sad 2.7%
Angry 1.9%
Confused 1.4%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Female, 52.2%
Sad 99.8%
Calm 12.9%
Fear 9.4%
Surprised 7.2%
Angry 2.7%
Disgusted 2.3%
Confused 2.1%
Happy 0.7%

AWS Rekognition

Age 27-37
Gender Male, 58.9%
Calm 80.4%
Surprised 7%
Fear 6.3%
Sad 5.2%
Happy 4.2%
Confused 2.5%
Disgusted 2.3%
Angry 1.7%

AWS Rekognition

Age 29-39
Gender Male, 93.7%
Calm 42.1%
Confused 13.7%
Disgusted 13.4%
Surprised 11.8%
Fear 7.6%
Sad 7.2%
Angry 7.1%
Happy 2.7%

AWS Rekognition

Age 20-28
Gender Female, 59.4%
Calm 96.2%
Surprised 6.4%
Fear 6%
Sad 2.7%
Confused 0.8%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 16-24
Gender Male, 92.3%
Calm 52.3%
Sad 23.8%
Surprised 8.2%
Fear 7.6%
Confused 7.5%
Angry 6.6%
Happy 5.2%
Disgusted 2.2%

AWS Rekognition

Age 24-34
Gender Male, 50.6%
Surprised 78%
Sad 17.7%
Fear 14.5%
Calm 9.1%
Happy 5.1%
Angry 3.5%
Confused 3.5%
Disgusted 1.8%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Adult 99%
Male 99%
Man 99%