Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5071

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5071

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 98.9
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 96.9
Adult 96.9
Male 96.9
Man 96.9
Person 96.8
Adult 96.8
Male 96.8
Man 96.8
Person 96.5
Baby 96.5
Person 94.8
Person 94.5
Person 94.2
Adult 94.2
Male 94.2
Man 94.2
Person 91.6
Person 90.5
Face 89.9
Head 89.9
Person 88.6
Musical Instrument 88.2
Person 86.2
Person 83.1
Person 82.4
Person 81.3
Person 80.2
Person 78.7
Person 77.9
Drum 77.4
Percussion 77.4
Person 69
Person 65.4
Performer 63.5
Person 61.1
Leisure Activities 57.4
Music 57.4
Musician 57.4
Drummer 56.1

Clarifai
created on 2018-05-10

people 99.9
many 99.2
group 98.8
music 98.7
adult 97.1
crowd 97.1
group together 95.9
musician 95.7
recreation 95.5
man 95
administration 93.6
audience 93
woman 91.4
military 90.9
spectator 89.4
war 87.9
instrument 87
wear 86.6
guitar 86.2
leader 85.9

Imagga
created on 2023-10-05

banjo 100
stringed instrument 100
musical instrument 95.4
man 20.8
hat 20.6
male 20.5
music 19.9
person 19.8
adult 19.4
guitar 18.6
people 18.4
brass 17.7
black 17.4
portrait 16.8
play 15.5
musician 15.4
sport 14.8
men 14.6
sexy 13.6
outdoor 13
fashion 12.8
playing 12.7
musical 12.4
lifestyle 12.3
wind instrument 12.2
rock 12.1
instrument 12.1
cornet 12
fun 12
attractive 11.9
model 11.7
retro 11.5
happy 11.3
old 11.1
happiness 11
face 10.6
player 10.4
guy 10.3
women 10.3
megaphone 10.2
smile 10
body 9.6
athlete 9.5
dark 9.2
leisure 9.1
hand 9.1
vintage 9.1
one 8.9
acoustic 8.8
looking 8.8
ball 8.7
expression 8.5
pretty 8.4
power 8.4
holding 8.2
fitness 8.1
bass 8.1
posing 8
guitarist 7.9
cowboy 7.8
boy 7.8
song 7.8
antique 7.8
drum 7.8
band 7.8
athletic 7.6
dance 7.6
sound 7.5
acoustic device 7.4
style 7.4
active 7.4
entertainment 7.4
competition 7.3
lady 7.3
teenager 7.3
exercise 7.3
art 7.1
game 7.1

Google
created on 2018-05-10

people 96.6
photograph 95.3
black and white 89.3
monochrome photography 71.2
history 70.6
tree 67.8
crowd 67.2
monochrome 66.7
recreation 58.9
stock photography 51.8

Microsoft
created on 2018-05-10

person 98.2
outdoor 97.7
people 68.1
group 63.8
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Female, 97.6%
Fear 96.9%
Surprised 6.4%
Calm 3.8%
Sad 2.3%
Angry 1.8%
Confused 0.7%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Male, 83.2%
Sad 99.1%
Calm 38.4%
Surprised 6.4%
Fear 6%
Confused 0.8%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 4-10
Gender Female, 57.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.7%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 16-22
Gender Male, 97%
Calm 97.2%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 2.2%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 76.6%
Confused 14.5%
Surprised 6.4%
Sad 6.3%
Fear 5.9%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.5%
Sad 100%
Fear 7.2%
Surprised 6.3%
Calm 2.1%
Confused 1%
Angry 1%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Confused 51.3%
Surprised 40.4%
Fear 7.6%
Sad 5.7%
Angry 5.1%
Calm 4%
Disgusted 1.2%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 97.8%
Sad 100%
Calm 8%
Surprised 6.5%
Fear 6%
Happy 4.6%
Confused 1.3%
Disgusted 0.8%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Female, 98.6%
Sad 99.8%
Surprised 20.6%
Fear 6.1%
Calm 4.5%
Confused 4.1%
Disgusted 1.5%
Happy 0.8%
Angry 0.7%

AWS Rekognition

Age 14-22
Gender Female, 97.1%
Calm 90.3%
Surprised 8.8%
Fear 6%
Sad 2.9%
Confused 2.3%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 80.1%
Surprised 10.3%
Fear 6.3%
Happy 4.4%
Sad 3.2%
Angry 2.3%
Confused 1.5%
Disgusted 1.4%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Calm 99.5%
Surprised 6.3%
Fear 6.1%
Sad 2.1%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 71.9%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 6-14
Gender Female, 95.4%
Calm 57.6%
Surprised 48.1%
Fear 8.2%
Confused 2.8%
Sad 2.6%
Disgusted 1.3%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 20-28
Gender Male, 64.2%
Calm 87.3%
Fear 7.6%
Surprised 6.4%
Sad 4.8%
Happy 0.9%
Confused 0.7%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 20-28
Gender Male, 96.5%
Calm 53.5%
Sad 20.7%
Fear 16.9%
Surprised 10.4%
Confused 1.8%
Angry 1.4%
Disgusted 0.9%
Happy 0.9%

AWS Rekognition

Age 4-12
Gender Female, 74.9%
Surprised 45.9%
Calm 41.5%
Fear 10.1%
Sad 7.4%
Angry 4.4%
Confused 3.2%
Disgusted 2%
Happy 1.4%

AWS Rekognition

Age 18-26
Gender Male, 94%
Calm 52.4%
Fear 36%
Surprised 8%
Disgusted 3.1%
Sad 3%
Angry 2.8%
Happy 2.6%
Confused 0.8%

AWS Rekognition

Age 16-22
Gender Male, 99.2%
Calm 86.8%
Surprised 7.9%
Fear 7%
Sad 3.1%
Confused 1.8%
Angry 1.8%
Happy 0.8%
Disgusted 0.7%

AWS Rekognition

Age 12-20
Gender Male, 96.5%
Calm 70.4%
Angry 9.9%
Surprised 8.8%
Sad 6.6%
Fear 6.3%
Confused 2.7%
Happy 2.3%
Disgusted 1.2%

AWS Rekognition

Age 20-28
Gender Male, 99.5%
Fear 57.6%
Calm 30.1%
Surprised 14.2%
Confused 3.9%
Disgusted 3.6%
Sad 3%
Happy 2.3%
Angry 1.2%

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Baby
Person 97.6%
Person 96.9%
Person 96.8%
Person 96.5%
Person 94.8%
Person 94.5%
Person 94.2%
Person 91.6%
Person 90.5%
Person 88.6%
Person 86.2%
Person 83.1%
Person 82.4%
Person 81.3%
Person 80.2%
Person 78.7%
Person 77.9%
Person 69%
Person 65.4%
Person 61.1%
Adult 97.6%
Adult 96.9%
Adult 96.8%
Adult 94.2%
Male 97.6%
Male 96.9%
Male 96.8%
Male 94.2%
Man 97.6%
Man 96.9%
Man 96.8%
Man 94.2%
Baby 96.5%