Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5134

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5134

Machine Generated Data

Tags

Amazon
created on 2023-10-07

People 99.9
Person 98.4
Adult 98.4
Bride 98.4
Female 98.4
Wedding 98.4
Woman 98.4
Person 98
Boy 98
Child 98
Male 98
Person 97.6
Person 96.6
Adult 96.6
Bride 96.6
Female 96.6
Woman 96.6
Person 96.1
Adult 96.1
Male 96.1
Man 96.1
Person 95.7
Person 95
Adult 95
Bride 95
Female 95
Woman 95
Person 92.6
Person 90.6
Person 79.2
Outdoors 78.4
Face 76.7
Head 76.7
Person 75
Person 72.2
Person 67.6
Person 62.5
Person 62.3
Person 59.8
Animal 56.4
Bull 56.4
Mammal 56.4
Play Area 55.7
Acrobatic 55.4
Weapon 55.4

Clarifai
created on 2018-05-10

people 100
many 99.3
group 99
group together 98.9
man 95.6
adult 94.6
military 88.5
administration 88.1
war 86.6
soldier 85.5
child 84.9
crowd 84.9
several 82.6
recreation 82
woman 80.6
wear 78.7
boy 77.7
leader 73.9
slavery 70.2
campsite 70.2

Imagga
created on 2023-10-07

brass 30.2
trombone 28.6
man 28.2
people 25.6
wind instrument 24.6
outdoor 20.6
musical instrument 19.7
sport 18.4
person 17.9
outdoors 16.7
male 16.4
silhouette 15.7
walking 14.2
summer 13.5
landscape 13.4
couple 13.1
snow 13
winter 12.8
sky 12.7
lifestyle 12.3
beach 11.9
kin 11.9
together 11.4
adult 11
vacation 10.6
mountain 9.9
sunset 9.9
family 9.8
old 9.7
group 9.7
active 9.4
world 9.3
life 9.1
park 9.1
fun 9
forest 8.7
hiking 8.7
men 8.6
walk 8.6
season 8.6
outside 8.6
grunge 8.5
clouds 8.4
travel 8.4
clothing 8.3
leisure 8.3
black 7.9
boy 7.8
portrait 7.8
tree 7.8
dusk 7.6
ocean 7.6
field 7.5
city 7.5
holding 7.4
water 7.3
trees 7.1
businessman 7.1
happiness 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.1
outdoor 98.7
people 75.6
posing 74.5
group 73.9
black 73.1
white 70.5
old 67.7
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Male, 62.9%
Calm 87.5%
Surprised 7.8%
Angry 7.1%
Fear 6.1%
Sad 2.2%
Disgusted 0.8%
Confused 0.6%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Male, 98.5%
Fear 57%
Calm 27%
Angry 10.7%
Surprised 8.8%
Disgusted 5%
Confused 3.5%
Sad 2.9%
Happy 1.9%

AWS Rekognition

Age 25-35
Gender Male, 96.1%
Calm 44.8%
Surprised 27.6%
Confused 12.4%
Fear 8.5%
Angry 8.1%
Disgusted 4%
Sad 3.2%
Happy 1.6%

AWS Rekognition

Age 14-22
Gender Male, 99.8%
Calm 79.6%
Surprised 9%
Fear 8.9%
Angry 3.7%
Sad 2.8%
Disgusted 1.6%
Happy 1.1%
Confused 0.8%

AWS Rekognition

Age 11-19
Gender Male, 85.3%
Angry 37.8%
Calm 23.5%
Fear 15.3%
Surprised 14.1%
Disgusted 5.4%
Sad 3.7%
Confused 1.9%
Happy 1.1%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 86.5%
Surprised 6.9%
Fear 6.1%
Confused 4.1%
Angry 3.4%
Sad 3.2%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 91.7%
Surprised 6.5%
Fear 6.1%
Sad 3.4%
Confused 2.2%
Angry 0.9%
Happy 0.4%
Disgusted 0.4%

AWS Rekognition

Age 18-24
Gender Male, 89.4%
Calm 65.7%
Happy 12.4%
Surprised 8.9%
Fear 8.2%
Angry 6%
Sad 3.6%
Confused 1.3%
Disgusted 1.2%

AWS Rekognition

Age 18-24
Gender Male, 88.6%
Surprised 85.9%
Calm 18.5%
Fear 10.3%
Confused 8.7%
Sad 4.6%
Happy 2.2%
Angry 2%
Disgusted 1.8%

AWS Rekognition

Age 16-24
Gender Male, 99.4%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 48-54
Gender Male, 98.1%
Calm 71.8%
Sad 14.9%
Confused 8.2%
Surprised 6.8%
Fear 6%
Happy 2.2%
Disgusted 0.9%
Angry 0.9%

AWS Rekognition

Age 6-12
Gender Female, 62.7%
Calm 84.4%
Fear 7.6%
Surprised 6.5%
Confused 6.3%
Sad 2.6%
Angry 2.1%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 25-35
Gender Male, 55%
Calm 90.2%
Surprised 6.6%
Fear 6.1%
Sad 3.3%
Confused 2.1%
Angry 1.6%
Disgusted 1.5%
Happy 0.2%

AWS Rekognition

Age 14-22
Gender Male, 90.4%
Calm 86.3%
Angry 6.9%
Surprised 6.5%
Fear 6.3%
Sad 3.4%
Confused 0.7%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 13-21
Gender Male, 94%
Calm 76.2%
Angry 12.7%
Surprised 7.4%
Fear 6.2%
Sad 3.3%
Confused 1.8%
Disgusted 1.7%
Happy 1.5%

AWS Rekognition

Age 4-12
Gender Male, 93.8%
Calm 78.4%
Fear 8.4%
Angry 7.2%
Surprised 6.6%
Confused 3.7%
Sad 3.2%
Happy 0.8%
Disgusted 0.7%

AWS Rekognition

Age 11-19
Gender Male, 99.4%
Angry 81%
Calm 12%
Surprised 8.2%
Fear 6.6%
Sad 2.4%
Confused 0.3%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 16-24
Gender Female, 61.8%
Angry 85.7%
Calm 7.7%
Fear 7%
Surprised 6.7%
Sad 2.8%
Disgusted 0.6%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 11-19
Gender Male, 94.7%
Calm 97.5%
Surprised 6.3%
Fear 6.1%
Sad 2.5%
Disgusted 0.4%
Happy 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 16-22
Gender Male, 86.9%
Calm 96.1%
Surprised 6.3%
Fear 6%
Sad 3.1%
Confused 0.3%
Happy 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 6-16
Gender Male, 99.6%
Calm 98.2%
Surprised 6.3%
Fear 6.1%
Sad 2.2%
Angry 0.7%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 6-12
Gender Male, 59.9%
Calm 39.2%
Fear 19.2%
Angry 15.3%
Sad 9.8%
Happy 8.5%
Surprised 7.1%
Disgusted 2.8%
Confused 1.5%

AWS Rekognition

Age 16-24
Gender Female, 53.7%
Fear 58.5%
Calm 37.9%
Surprised 6.8%
Happy 4.2%
Sad 4.2%
Angry 3.2%
Disgusted 1.3%
Confused 1%

Microsoft Cognitive Services

Age 16
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Adult 98.4%
Bride 98.4%
Female 98.4%
Woman 98.4%
Boy 98%
Child 98%
Male 98%
Man 96.1%