Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4527.4

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4527.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 99.9
Person 98.7
Adult 98.7
Male 98.7
Man 98.7
Dancing 96.4
Leisure Activities 96.4
Person 96.3
Person 95.3
Person 94.1
Person 92.8
Person 92
Person 91.5
Person 90.8
Person 88.3
Person 87.8
Person 86.4
Person 86.2
Person 85.8
Person 85.3
Person 84
Person 83
Person 80.3
Person 75.6
Person 74.1
Person 73.1
Person 69.6
Stilts 68.8
Person 68.6
Person 68.3
Head 67.3
Face 65.6
Person 64.7
Person 64.2
Clothing 63
Shorts 63
Person 61.6
Person 61.2
Plant 57.4
Tree 57.4
Sword 56.2
Weapon 56.2
Skirt 56.2

Clarifai
created on 2018-05-10

people 99.8
group together 98.4
many 96.2
monochrome 95.5
adult 95.2
man 94.1
group 92.4
wear 89.3
several 88.1
child 86.2
cavalry 84.5
woman 83.7
military 81.9
two 81.2
war 81.2
leader 78.9
administration 78.9
street 74.9
recreation 73.6
crowd 73.5

Imagga
created on 2023-10-06

horse 81.2
vaulting horse 71.2
gymnastic apparatus 42.7
sports equipment 36.1
sport 23.8
animal 21.9
man 16.8
harness 15.9
equipment 15.8
people 15.6
support 14.1
cowboy 13.5
sunset 13.5
outdoor 13
competition 12.8
male 12.8
outdoors 12.7
rope 12.4
protection 11.8
horses 11.7
silhouette 11.6
run 11.6
sky 11.5
stick 11.4
action 11.1
athlete 11.1
grass 11.1
device 10.8
stallion 10.8
person 10.6
travel 10.6
crutch 10.5
black 10.2
player 10.1
beach 10.1
danger 10
mammal 9.7
mask 9.6
sculpture 9.6
statue 9.5
power 9.2
speed 9.2
dirty 9
active 9
weapon 9
sword 8.9
sun 8.9
equine 8.8
protective 8.8
ride 8.7
lifestyle 8.7
play 8.6
men 8.6
line 8.6
adult 8.5
field 8.4
staff 8.3
ballplayer 8.3
industrial 8.2
game 8
saddle 8
stalker 7.9
jockey 7.9
sand 7.9
radioactive 7.9
fountain 7.9
equestrian 7.8
radiation 7.8
destruction 7.8
accident 7.8
toxic 7.8
riding 7.8
nuclear 7.8
chemical 7.7
summer 7.7
gas 7.7
running 7.7
old 7.7
animals 7.4
vacation 7.4
brown 7.4
freedom 7.3
recreation 7.2
history 7.2
farm 7.1
structure 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 94
sport 74.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 25-35
Gender Male, 99.7%
Calm 96.8%
Surprised 6.4%
Fear 5.9%
Happy 2.4%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 28-38
Gender Female, 94.8%
Happy 82.1%
Calm 15.2%
Surprised 6.3%
Fear 6.2%
Sad 2.3%
Angry 1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 50.7%
Calm 70.7%
Happy 12.7%
Surprised 7.2%
Fear 6.8%
Sad 4.7%
Disgusted 4%
Angry 2.5%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Male, 54.1%
Calm 55.3%
Happy 36%
Surprised 7.7%
Fear 6.1%
Sad 2.8%
Confused 1.8%
Angry 1.1%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Male, 99.5%
Happy 43%
Calm 37.6%
Surprised 8.4%
Fear 6.7%
Sad 5.1%
Angry 4.7%
Disgusted 2.1%
Confused 0.6%

AWS Rekognition

Age 18-26
Gender Male, 84.9%
Calm 52.2%
Angry 33.3%
Surprised 7.5%
Fear 6.5%
Sad 5.1%
Happy 2%
Disgusted 1.2%
Confused 1%

AWS Rekognition

Age 27-37
Gender Female, 72.4%
Happy 71.1%
Surprised 16%
Fear 6%
Calm 5.4%
Angry 4.5%
Disgusted 4%
Sad 2.7%
Confused 0.8%

AWS Rekognition

Age 33-41
Gender Male, 99.7%
Sad 81.1%
Happy 19.3%
Calm 14.2%
Angry 13.3%
Fear 8.1%
Surprised 7.7%
Disgusted 6.9%
Confused 1.7%

AWS Rekognition

Age 14-22
Gender Female, 91.9%
Calm 95.2%
Surprised 6.3%
Fear 6.3%
Sad 2.8%
Happy 1.2%
Angry 0.3%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Female, 55.9%
Fear 55.6%
Happy 26.6%
Surprised 13.3%
Calm 8.7%
Sad 3.7%
Angry 3.6%
Disgusted 1.6%
Confused 1.2%

AWS Rekognition

Age 27-37
Gender Male, 95%
Disgusted 43.5%
Happy 31.7%
Surprised 9.6%
Fear 7.4%
Angry 6.6%
Calm 6.5%
Sad 2.6%
Confused 1.3%

AWS Rekognition

Age 27-37
Gender Male, 99.4%
Calm 52.4%
Happy 21.6%
Disgusted 16.2%
Surprised 6.9%
Fear 6.3%
Sad 3.9%
Confused 1.9%
Angry 1.1%

Feature analysis

Amazon

Person 98.7%
Adult 98.7%
Male 98.7%
Man 98.7%

Captions

Text analysis

Amazon

College
and
Art
Fellows
(Harvard
of
Museums)
Harvard
University
President
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4527.0004
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4527.0004
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4527.0004