Human Generated Data

Title

Untitled (Bernarda Bryson Shahn, Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5081

Human Generated Data

Title

Untitled (Bernarda Bryson Shahn, Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5081

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Adult 98.8
Bride 98.8
Female 98.8
Person 98.8
Wedding 98.8
Woman 98.8
Female 97.8
Person 97.8
Child 97.8
Girl 97.8
Female 97.6
Person 97.6
Child 97.6
Girl 97.6
Person 97.6
Adult 96.9
Person 96.9
Male 96.9
Man 96.9
Face 96.9
Head 96.9
Photography 96.9
Portrait 96.9
Adult 96.8
Bride 96.8
Female 96.8
Person 96.8
Woman 96.8
People 95
Person 92.9
Person 89.4
Person 89.1
Person 85.7
Person 85.6
Person 85.5
Person 85.3
Adult 82.7
Bride 82.7
Female 82.7
Person 82.7
Woman 82.7
Person 77.9
Person 75.5
Clothing 71.2
Costume 71.2
Person 69.1
Person 65.4
Person 65.1
Crowd 57.7
Coat 57.2
Festival 57.2
Sword 56.9
Weapon 56.9
Parade 55.6
Plant 55.5
Vegetation 55.5
Performer 55
Hat 55

Clarifai
created on 2018-05-10

people 99.9
group 98.4
adult 95.6
music 94.6
group together 94.1
woman 94.1
child 94
man 93.6
musician 92
many 91
facial expression 90.6
administration 88.1
wear 86
actor 84.4
military 84.1
war 83.3
portrait 81.6
outfit 81.5
singer 81
recreation 80.5

Imagga
created on 2023-10-06

trombone 29.4
brass 27.6
man 25.5
person 23.4
wind instrument 22.4
musical instrument 21.5
male 20.6
people 20.6
mask 18.8
portrait 18.1
war 15.4
weapon 15
adult 15
military 14.5
soldier 13.7
protection 12.7
old 12.5
helmet 11.9
clothing 11.8
history 11.6
world 10.9
sword 10.7
happy 10.6
fun 10.5
couple 10.4
ancient 9.5
day 9.4
smiling 9.4
covering 9.3
sport 9.2
outdoor 9.2
battle 8.8
armor 8.7
happiness 8.6
uniform 8.6
men 8.6
culture 8.5
historical 8.5
black 8.4
art 8.4
dark 8.3
fashion 8.3
vintage 8.3
historic 8.2
costume 8.2
danger 8.2
love 7.9
together 7.9
conflict 7.8
warrior 7.8
statue 7.8
scene 7.8
antique 7.8
fight 7.7
bride 7.7
park 7.5
human 7.5
city 7.5
outdoors 7.5
holding 7.4
girls 7.3
dress 7.2
suit 7.2
holiday 7.2
gun 7.1
family 7.1
to 7.1
device 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 97.7
person 95.3
posing 89.7
old 89.4
group 86.8
people 76.4
black 68.1
white 67.4
vintage 38.9
clothes 38.7
dressed 29.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 99.8%
Disgusted 52.4%
Angry 16.6%
Surprised 10.7%
Confused 8.5%
Fear 7%
Calm 6.5%
Sad 4.6%
Happy 1%

AWS Rekognition

Age 9-17
Gender Male, 99.9%
Surprised 52.6%
Sad 36.8%
Calm 23.2%
Fear 11.2%
Confused 6.3%
Angry 2.4%
Disgusted 1.3%
Happy 0.7%

AWS Rekognition

Age 43-51
Gender Female, 100%
Calm 42.8%
Sad 36.6%
Confused 12.2%
Fear 12.2%
Surprised 8.5%
Angry 2.3%
Happy 2.1%
Disgusted 1.9%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Calm 49%
Fear 24.7%
Sad 12.6%
Surprised 7.3%
Angry 5.7%
Confused 3.8%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 97.8%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 1.2%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 16-24
Gender Female, 87.8%
Calm 51.3%
Confused 14.9%
Sad 13.4%
Surprised 7.9%
Fear 7.1%
Angry 6.8%
Disgusted 3.8%
Happy 3.4%

AWS Rekognition

Age 18-24
Gender Male, 90.5%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Disgusted 0.3%
Confused 0.2%
Angry 0.2%
Happy 0%

AWS Rekognition

Age 16-22
Gender Female, 99.8%
Calm 86.7%
Angry 7.3%
Surprised 6.8%
Fear 6%
Sad 3%
Confused 1.6%
Disgusted 0.6%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 97.1%
Sad 99.6%
Confused 14.3%
Fear 12.3%
Surprised 6.7%
Calm 2.6%
Disgusted 2.1%
Angry 1.7%
Happy 1.4%

AWS Rekognition

Age 18-26
Gender Female, 94.4%
Surprised 98.5%
Fear 7.5%
Angry 6.1%
Confused 4.4%
Sad 2.6%
Disgusted 2.1%
Calm 1.4%
Happy 1.1%

AWS Rekognition

Age 16-24
Gender Female, 84.5%
Sad 48.6%
Surprised 41.4%
Calm 36.8%
Fear 6.8%
Confused 2.3%
Angry 1.9%
Disgusted 1.7%
Happy 1.2%

AWS Rekognition

Age 18-26
Gender Male, 95.6%
Surprised 71.7%
Calm 29%
Angry 11.7%
Fear 7%
Disgusted 5.7%
Sad 4.1%
Confused 2.1%
Happy 1.8%

AWS Rekognition

Age 18-26
Gender Male, 66.2%
Calm 95%
Surprised 6.3%
Fear 5.9%
Sad 3.7%
Happy 0.5%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 10-18
Gender Male, 92.9%
Calm 78.2%
Fear 13.7%
Surprised 7.6%
Sad 3%
Confused 1.6%
Angry 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 18-24
Gender Male, 97.7%
Sad 99.9%
Confused 14.7%
Surprised 8.6%
Fear 6.3%
Happy 2.1%
Angry 1.2%
Calm 0.9%
Disgusted 0.4%

AWS Rekognition

Age 20-28
Gender Female, 82.1%
Fear 83.8%
Calm 20.6%
Surprised 9.7%
Happy 3.3%
Sad 2.4%
Angry 2.4%
Disgusted 1.2%
Confused 0.4%

AWS Rekognition

Age 6-16
Gender Male, 98.7%
Calm 46.8%
Confused 25.6%
Surprised 21%
Sad 7.8%
Fear 6.3%
Angry 0.5%
Disgusted 0.3%
Happy 0.1%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.8%
Bride 98.8%
Female 98.8%
Person 98.8%
Woman 98.8%
Child 97.8%
Girl 97.8%
Male 96.9%
Man 96.9%