Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5124

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5124

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
People 99.7
Clothing 99.5
Person 98.6
Adult 98.6
Adult 98.6
Bride 98.6
Female 98.6
Female 98.6
Wedding 98.6
Woman 98.6
Person 98.3
Adult 98.3
Female 98.3
Woman 98.3
Person 97.4
Female 97.4
Child 97.4
Girl 97.4
Person 97.3
Child 97.3
Boy 97.3
Male 97.3
Person 96.6
Adult 96.6
Female 96.6
Woman 96.6
Person 96.6
Person 96.1
Person 94.6
Person 94
Female 94
Child 94
Girl 94
Dress 93.6
Person 93.5
Baby 93.5
Coat 92.2
Person 90.2
Person 89.3
Person 88.1
Person 87.1
Person 86.5
Child 86.5
Boy 86.5
Male 86.5
Person 82.2
Slum 80.2
Person 79.1
Outdoors 63.4
Person 58.6
Happy 57.6
Smile 57.6
Shorts 56.1
Fashion 55.5
Barefoot 55.4
Body Part 55.4
Finger 55.4
Hand 55.4
Hat 55.2

Clarifai
created on 2018-05-10

people 99.9
group 99.6
child 98.8
group together 98.6
man 96.7
many 96.4
adult 95.9
war 94.4
woman 94.3
five 91.8
military 91.5
several 90.8
wear 90
four 89
family 88.9
son 88.6
boy 87.7
administration 87.5
portrait 87.2
facial expression 86.2

Imagga
created on 2023-10-06

kin 82.6
statue 22.9
people 22.9
uniform 22.7
sculpture 22
clothing 21
military uniform 20.9
child 20.2
man 19.5
outdoors 18.7
male 18.6
person 16.9
travel 15.5
old 15.3
park 14.8
ancient 14.7
soldier 14.7
military 14.5
stone 14.3
outdoor 13.8
history 13.4
tourism 13.2
monument 13.1
couple 13.1
army 12.7
day 12.5
religion 12.5
happy 12.5
architecture 12.5
adult 12.4
mother 11.9
happiness 11.7
portrait 11.6
lifestyle 11.6
war 11.5
group 11.3
art 11.2
family 10.7
autumn 10.5
fun 10.5
boy 10.4
smiling 10.1
peace 10
marble 9.7
sibling 9.5
love 9.5
outside 9.4
culture 9.4
religious 9.4
city 9.1
landmark 9
gray 9
sky 8.9
consumer goods 8.8
together 8.8
women 8.7
covering 8.6
holiday 8.6
parent 8.5
casual 8.5
world 8.4
vintage 8.3
juvenile 8.2
girls 8.2
building 8.2
protection 8.2
danger 8.2
camouflage 7.8
gun 7.8
antique 7.8
weapon 7.7
men 7.7
god 7.6
friends 7.5
decoration 7.2
life 7.2
black 7.2
smile 7.1
face 7.1
to 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.7
posing 93.8
group 90.4
outdoor 87.9
standing 83.1
white 66.5
old 66.2
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 14-22
Gender Female, 100%
Confused 73.3%
Happy 20.7%
Fear 6.8%
Surprised 6.7%
Sad 2.5%
Disgusted 1.1%
Calm 0.5%
Angry 0.3%

AWS Rekognition

Age 6-12
Gender Male, 92.3%
Sad 100%
Calm 7.9%
Surprised 6.4%
Fear 6%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 0.9%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 98.9%
Calm 97.4%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Confused 0.5%
Angry 0.4%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 0-4
Gender Male, 99.1%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 0-3
Gender Male, 99.8%
Sad 99.9%
Calm 17.8%
Surprised 6.5%
Fear 5.9%
Confused 4.2%
Angry 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 0-4
Gender Female, 81.3%
Sad 100%
Confused 6.4%
Surprised 6.3%
Fear 5.9%
Calm 0.5%
Happy 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 4-10
Gender Male, 98.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 2.9%
Angry 1.2%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-12
Gender Male, 91.5%
Calm 85.2%
Surprised 6.8%
Angry 6.1%
Fear 6%
Sad 4.9%
Confused 1%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 98.5%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Calm 0.5%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 56-64
Gender Female, 63.8%
Happy 62.9%
Sad 23.6%
Calm 9.1%
Fear 7%
Surprised 6.8%
Angry 2.5%
Confused 2.2%
Disgusted 1%

AWS Rekognition

Age 2-8
Gender Female, 98.9%
Calm 97.5%
Surprised 6.8%
Fear 5.9%
Sad 2.2%
Happy 0.7%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 96.8%
Calm 83.2%
Surprised 7%
Sad 6.8%
Fear 6.3%
Angry 4.3%
Disgusted 0.7%
Happy 0.5%
Confused 0.5%

AWS Rekognition

Age 18-24
Gender Female, 53.6%
Sad 98.9%
Calm 24.8%
Happy 8.6%
Surprised 6.8%
Fear 6.5%
Confused 2.5%
Angry 2.3%
Disgusted 1.1%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Adult 98.6%
Bride 98.6%
Female 98.6%
Woman 98.6%
Child 97.4%
Girl 97.4%
Boy 97.3%
Male 97.3%
Baby 93.5%
Shorts 56.1%

Categories

Imagga

paintings art 90.4%
people portraits 9.3%