Human Generated Data

Title

Untitled (Horse Dance, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4517.2

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4517.2

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 99.2
Person 97.2
Boy 97.2
Child 97.2
Male 97.2
Person 96.1
Boy 96.1
Child 96.1
Male 96.1
Person 95.4
Person 94.8
Male 94.8
Adult 94.8
Man 94.8
Person 93.8
Person 93
Person 92.6
Person 91.8
Clothing 91.7
Shorts 91.7
Person 91.4
Hat 88.8
Person 87.7
Person 84.1
Person 82.5
Person 82.5
Person 82.3
Face 80.1
Head 80.1
Person 79.3
Person 78.4
Crowd 77.7
Person 77.5
Person 76.4
Person 73.8
Person 72
Person 71.3
Person 67.9
Outdoors 66.5
Person 65.1
Person 63.3
Person 62.9
Dancing 61.4
Leisure Activities 61.4
Person 61
Person 61
Festival 56.4
Plant 56.3
Tree 56.3
Hula 56.2
Toy 56.2
Skirt 56.1
Walking 55.4
Dress 55.4

Clarifai
created on 2018-05-10

people 99.8
group 96.6
man 95.8
monochrome 95.8
adult 95.7
woman 95.4
group together 95.3
many 93.6
crowd 87.6
child 87
wear 81.2
street 80.1
music 80
recreation 79.3
dancer 77.7
dancing 76.5
several 73.6
administration 73.1
sit 72.5
art 72.1

Imagga
created on 2023-10-06

fountain 36.7
snow 36.4
winter 28.1
structure 27.7
tree 26.6
cold 19.8
old 19.5
landscape 19.3
park 18.9
forest 18.3
frost 16.3
weather 16
ice 15.2
outdoors 13.7
art 13.2
season 13.2
texture 13.2
outdoor 13
grunge 12.8
sky 12.7
frozen 12.4
stone 11.7
vintage 11.6
life 11.5
black 11.4
scene 11.2
person 11.2
people 11.2
city 10.8
trees 10.7
world 9.5
garden 9.2
aged 9
dirty 9
scenery 9
sculpture 8.9
snowy 8.7
sepia 8.7
man 8.7
covered 8.7
clothing 8.7
film 8.7
light 8.7
antique 8.7
day 8.6
architecture 8.6
crystal 8.6
summer 8.4
color 8.3
decoration 8.3
branch 8.2
dress 8.1
water 8
statue 7.8
ancient 7.8
travel 7.7
men 7.7
field 7.5
pattern 7.5
mountains 7.4
kin 7.2
history 7.2
negative 7.1
sunlight 7.1
cool 7.1
textured 7

Google
created on 2018-05-10

black and white 93
monochrome photography 83.4
photography 79.2
monochrome 72.2
ceremony 63.8
recreation 61
girl 52.9
event 52.8
tree 51.2
style 50.4

Microsoft
created on 2018-05-10

outdoor 93.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Fear 82.8%
Sad 25.2%
Surprised 6.9%
Disgusted 5.2%
Confused 3%
Angry 2.5%
Happy 2.3%
Calm 2.1%

AWS Rekognition

Age 27-37
Gender Male, 77.1%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 98.5%
Calm 82.2%
Surprised 13%
Fear 6%
Confused 3.6%
Sad 2.6%
Disgusted 1.4%
Angry 0.9%
Happy 0.7%

AWS Rekognition

Age 41-49
Gender Male, 97.9%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 95.3%
Calm 77.6%
Fear 7.2%
Surprised 6.9%
Angry 6.5%
Happy 5.8%
Sad 2.9%
Confused 1.8%
Disgusted 1.5%

AWS Rekognition

Age 25-35
Gender Male, 98.5%
Calm 99.3%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Male, 51.2%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.3%
Disgusted 0.2%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 28-38
Gender Male, 70.3%
Calm 97.6%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Confused 0.7%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 99.7%
Calm 97.7%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Confused 0.5%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 36-44
Gender Female, 61.7%
Calm 99.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 30-40
Gender Male, 96.9%
Calm 97%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1.5%
Confused 0.5%
Disgusted 0.5%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 45.9%
Angry 43.9%
Surprised 7%
Fear 6.2%
Confused 2.9%
Sad 2.8%
Disgusted 2%
Happy 1.1%

AWS Rekognition

Age 26-36
Gender Female, 95.2%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 40-48
Gender Male, 76.9%
Calm 63%
Sad 25.2%
Surprised 8.6%
Confused 7.3%
Fear 7.1%
Happy 1.3%
Disgusted 1.2%
Angry 1.2%

AWS Rekognition

Age 23-33
Gender Female, 82.8%
Calm 97.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.8%
Happy 0.4%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 59.7%
Sad 73.6%
Happy 32.5%
Angry 28.2%
Surprised 7.2%
Fear 6.3%
Calm 1.3%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 16-24
Gender Female, 68%
Fear 70.8%
Calm 25.8%
Surprised 12.9%
Happy 3.1%
Sad 3%
Disgusted 1.8%
Angry 1.7%
Confused 1.5%

AWS Rekognition

Age 18-24
Gender Female, 66.4%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.3%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%

Feature analysis

Amazon

Person 97.2%
Boy 97.2%
Child 97.2%
Male 97.2%
Adult 94.8%
Man 94.8%

Categories

Imagga

nature landscape 60.1%
paintings art 38.1%
streetview architecture 1.2%

Text analysis

Amazon

Art
and
College
(Harvard
Fellows
Museums)
of
Harvard
University
© President and Fellows of Harvard College (Harvard University Art Museums)
President
©
P1970.4517.0002

Google

© President and Fellows of Harvard College (Harvard University Art Museums) P1970.4517.0002
©
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4517.0002