Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4527.2

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4527.2

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 98.6
Person 96.7
Adult 96.7
Male 96.7
Man 96.7
Person 96
Adult 96
Male 96
Man 96
Person 95.6
Adult 95.6
Female 95.6
Woman 95.6
Person 93.4
Person 92.9
Person 92.2
Adult 92.2
Male 92.2
Man 92.2
Person 90.1
People 88.5
Person 87.8
Face 84.9
Head 84.9
Musical Instrument 84.2
Person 84
Performer 83.5
Leisure Activities 83.5
Music 83.5
Musician 83.5
Drummer 79.6
Percussion 79.6
Person 77.4
Person 76.8
Person 76.8
Person 76.3
Person 75.6
Person 73.1
Person 69
Clothing 68.4
Shorts 68.4
Drum 67.7
Person 66.5
Person 63.1
Person 62.4
Person 61.4
Person 61.3
Person 60.5

Clarifai
created on 2018-05-10

people 99.8
group 98.8
group together 96.3
many 95.7
adult 95.4
woman 95
street 94.5
man 94.4
child 92.8
music 91
monochrome 89.9
crowd 88.6
wear 88.5
several 84.9
administration 84.3
family 79.4
dancer 78.5
war 75.4
dancing 74.2
sit 73.6

Imagga
created on 2023-10-06

pedestrian 31.3
fountain 26.6
structure 22
people 16.2
park 14.8
man 14.8
outdoor 13.8
snow 12.6
love 11.8
dress 11.7
bride 11.5
world 11.4
sport 11.3
old 11.1
stone 11.1
winter 11.1
city 10.8
history 10.7
travel 10.6
portrait 10.4
black 10.3
memorial 9.9
adult 9.7
person 9.6
walking 9.5
cold 9.5
day 9.4
happiness 9.4
tree 9.2
wedding 9.2
musical instrument 8.9
couple 8.7
outdoors 8.7
architecture 8.6
gravestone 8.6
cemetery 8.6
monument 8.4
sky 8.3
building 8.3
groom 8.1
holiday 7.9
summer 7.7
happy 7.5
silhouette 7.4
landscape 7.4
accordion 7.4
girls 7.3
active 7.2
celebration 7.2
women 7.1
together 7

Google
created on 2018-05-10

white 96
photograph 95.5
black 95
black and white 93.9
monochrome photography 88.5
photography 84.7
tree 81.7
monochrome 77.1
plant 75.4
recreation 73.5
style 56.5
fun 56.4
girl 55.9
flower 51.7
grass 51.1
world 50.2

Microsoft
created on 2018-05-10

outdoor 94
person 85.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Male, 90.4%
Disgusted 81.1%
Sad 10.9%
Surprised 6.4%
Fear 6%
Angry 2.7%
Happy 1.7%
Confused 0.9%
Calm 0.8%

AWS Rekognition

Age 27-37
Gender Male, 92.3%
Calm 71.9%
Sad 13.6%
Surprised 6.8%
Fear 6%
Confused 4.4%
Happy 4%
Angry 3.5%
Disgusted 1%

AWS Rekognition

Age 18-24
Gender Male, 91.8%
Fear 52.9%
Calm 19.7%
Happy 10.3%
Surprised 8.8%
Confused 7.9%
Sad 7.7%
Angry 3.8%
Disgusted 1.6%

AWS Rekognition

Age 16-24
Gender Male, 73.7%
Sad 96.5%
Calm 28.3%
Angry 8.9%
Fear 7.3%
Surprised 6.7%
Disgusted 4.4%
Happy 3.1%
Confused 0.9%

AWS Rekognition

Age 16-24
Gender Female, 96.4%
Angry 63%
Surprised 12%
Happy 11%
Calm 7.6%
Fear 6.2%
Disgusted 3.6%
Sad 3.5%
Confused 2.1%

AWS Rekognition

Age 23-33
Gender Female, 99.2%
Happy 58.6%
Disgusted 10.8%
Sad 10.1%
Surprised 9.8%
Fear 7.7%
Angry 4.5%
Calm 3.8%
Confused 0.8%

AWS Rekognition

Age 35-43
Gender Female, 64.9%
Sad 28%
Fear 27%
Calm 20.5%
Happy 18.8%
Surprised 7.3%
Confused 4.9%
Disgusted 4.4%
Angry 2.9%

AWS Rekognition

Age 10-18
Gender Female, 98.6%
Happy 36.9%
Calm 32.5%
Sad 22.3%
Fear 7.2%
Surprised 6.6%
Disgusted 3.4%
Angry 2.8%
Confused 2.4%

Feature analysis

Amazon

Person 98.6%
Adult 96.7%
Male 96.7%
Man 96.7%
Female 95.6%
Woman 95.6%
Shorts 68.4%

Categories

Text analysis

Amazon

College
and
Art
(Harvard
Fellows
of
Museums)
President
Harvard
University
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4527.0002
©

Google

C President and Fellows of Harvard College (Harvard University Art Museums) P1970.4527.0002
C
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4527.0002