Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5174

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5174

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Shorts 100
Adult 98.6
Male 98.6
Man 98.6
Person 98.6
Person 97.8
Adult 97.5
Person 97.5
Bride 97.5
Female 97.5
Wedding 97.5
Woman 97.5
People 97.5
Male 97.5
Person 97.5
Boy 97.5
Child 97.5
Person 96.9
Person 96
Person 95.6
Person 94.4
Person 93.8
Person 90.4
Adult 87.2
Male 87.2
Man 87.2
Person 87.2
Footwear 82.1
Shoe 82.1
Person 81.8
Face 80.2
Head 80.2
Shoe 76.2
Person 75.8
Person 73.5
Outdoors 70
Person 68.4
Person 67.7
Shoe 67
Person 62.3
Person 62.2
Skirt 56.9
Shoe 56.8
Back 56.8
Body Part 56.8
Dancing 56.7
Leisure Activities 56.7
Stilts 55.7

Clarifai
created on 2018-05-10

people 100
many 98.8
group together 98.7
group 97.7
military 95.7
war 95
man 93.6
adult 93.4
weapon 93.4
soldier 93
uniform 91.7
percussion instrument 89.2
drum 87.8
crowd 86.2
skirmish 85.8
child 85.1
wear 83.7
spectator 82.3
military uniform 81.3
drummer 80.3

Imagga
created on 2023-10-06

man 26.2
person 22.6
sport 21.6
people 21.2
male 20.6
outdoors 20
military 16.4
two 16.1
summer 16.1
sky 15.9
active 15.7
helmet 15.6
uniform 15.6
outdoor 15.3
weapon 14.9
travel 14.8
riding 14.6
crutch 14.4
horse 14.2
clothing 14
couple 13.9
vacation 13.9
happy 13.2
adult 13
outside 12.8
beach 12.8
recreation 12.5
war 12.5
leisure 12.4
boy 12.2
sports 12
trombone 12
engineer 11.9
child 11.9
ride 11.6
animal 11.6
lifestyle 11.6
sand 11.3
staff 11.3
fun 11.2
mountain 10.8
soldier 10.7
activity 10.7
family 10.7
together 10.5
military uniform 10.4
walking 10.4
planner 10.4
tourist 10.2
competition 10.1
danger 10
brass 9.8
countryside 9.1
stick 9.1
pedestrian 9
kid 8.9
bike 8.8
extreme 8.6
sunny 8.6
desert 8.6
adventure 8.5
gun 8.4
protection 8.2
bicycle 8.1
love 7.9
cycling 7.9
day 7.8
battle 7.8
sea 7.8
cycle 7.8
backpack 7.8
horses 7.8
wind instrument 7.7
field 7.5
action 7.5
cowboy 7.5
speed 7.3
history 7.1
grass 7.1
equipment 7
covering 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.3
person 96.7
group 85.9
people 82.4
old 77.9
black 76.4
posing 70.7
sport 70.5
white 63.4
clothes 33.5

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-31
Gender Male, 93.8%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.6%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Male, 98.6%
Calm 44.9%
Angry 24.3%
Sad 10.3%
Surprised 7.5%
Fear 7.4%
Disgusted 7.2%
Confused 3.5%
Happy 2.6%

AWS Rekognition

Age 14-22
Gender Male, 82.4%
Calm 88.9%
Surprised 6.5%
Fear 6.3%
Angry 6.2%
Sad 2.5%
Disgusted 1.3%
Confused 0.6%
Happy 0.4%

AWS Rekognition

Age 19-27
Gender Male, 98.8%
Calm 65.9%
Angry 25.1%
Surprised 7%
Fear 6.2%
Sad 3%
Happy 2.3%
Confused 1.1%
Disgusted 1%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Fear 93.2%
Surprised 8.8%
Angry 4.7%
Calm 4.2%
Sad 2.8%
Confused 2%
Happy 2%
Disgusted 0.8%

AWS Rekognition

Age 21-29
Gender Female, 62.3%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.2%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 97.9%
Calm 75.9%
Surprised 21.8%
Fear 5.9%
Confused 3.5%
Sad 2.5%
Angry 1.6%
Disgusted 0.9%
Happy 0.2%

AWS Rekognition

Age 16-22
Gender Female, 83.2%
Sad 58.8%
Calm 56.8%
Fear 7.8%
Surprised 7%
Disgusted 2.2%
Confused 2.2%
Happy 2.1%
Angry 1.6%

AWS Rekognition

Age 6-16
Gender Male, 99.5%
Calm 92.4%
Surprised 6.4%
Fear 6.1%
Happy 2.9%
Sad 2.7%
Angry 1.7%
Confused 0.5%
Disgusted 0.2%

AWS Rekognition

Age 9-17
Gender Male, 73.1%
Happy 85.2%
Fear 9.1%
Surprised 6.6%
Calm 4.1%
Sad 2.4%
Angry 1.2%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Sad 73.7%
Calm 43.5%
Surprised 7.4%
Angry 7.2%
Fear 6.7%
Disgusted 5.9%
Confused 3%
Happy 2.1%

AWS Rekognition

Age 25-35
Gender Female, 66.5%
Sad 100%
Calm 7.8%
Surprised 6.5%
Fear 6.2%
Happy 2.3%
Confused 1%
Disgusted 0.7%
Angry 0.3%

AWS Rekognition

Age 7-17
Gender Male, 100%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.7%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 95.9%
Calm 77.6%
Fear 7.9%
Surprised 6.8%
Sad 5.3%
Happy 4.1%
Angry 3.4%
Disgusted 1.8%
Confused 0.8%

Microsoft Cognitive Services

Age 14
Gender Male

Feature analysis

Amazon

Adult 98.6%
Male 98.6%
Man 98.6%
Person 98.6%
Bride 97.5%
Female 97.5%
Woman 97.5%
Boy 97.5%
Child 97.5%
Shoe 82.1%

Text analysis

Amazon

ح