Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4520.5

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4520.5

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.6
Hat 99.6
Adult 97.6
Male 97.6
Man 97.6
Person 97.6
Adult 97.5
Male 97.5
Man 97.5
Person 97.5
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
People 95.5
Person 95.5
Person 94.5
Baby 94.5
Person 94.5
Person 92.1
Adult 91.8
Male 91.8
Man 91.8
Person 91.8
Person 90.5
Person 90.3
Baby 90.3
Person 90.3
Crowd 90.1
Person 90.1
Person 89.8
Person 89.6
Person 88.6
Face 88.5
Head 88.5
Person 87.5
Person 85
Person 82.7
Person 79.3
Baseball Cap 78.4
Cap 78.4
Person 75.7
Body Part 73.7
Finger 73.7
Hand 73.7
Person 73.2
Audience 61.3
Person 58
Sun Hat 57.2
Photography 55.3
Portrait 55.3

Clarifai
created on 2018-05-10

people 99.7
group 98.2
adult 97.8
street 96.4
many 96.3
group together 94.6
woman 94.2
man 93.9
crowd 91.3
wear 90.4
administration 89.9
monochrome 89.9
child 89.7
music 87.8
leader 83.6
veil 83.2
musician 81
several 80.4
war 79.7
facial expression 77.3

Imagga
created on 2023-10-06

steel drum 100
percussion instrument 100
musical instrument 99.4
drum 30.4
man 20.1
person 18
people 17.8
hat 14.9
male 14.9
portrait 14.9
adult 13.6
music 13.5
men 12.9
happy 12.5
pretty 10.5
city 10
urban 9.6
musical 9.6
smile 9.3
joy 9.2
traditional 9.1
old 9
black 9
human 9
fun 9
metal 8.8
culture 8.5
face 8.5
attractive 8.4
instrument 8.4
hand 8.3
sexy 8
building 7.9
love 7.9
couple 7.8
happiness 7.8
clothing 7.8
party 7.7
one 7.5
musician 7.3
holiday 7.2
architecture 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 95.8
people 76

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 41-49
Gender Male, 99.2%
Calm 97.5%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Disgusted 0.6%
Angry 0.5%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Female, 91.2%
Calm 97.2%
Fear 6.7%
Surprised 6.3%
Sad 2.2%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 98.5%
Calm 97.7%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Happy 0.6%
Angry 0.5%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 43-51
Gender Male, 59.7%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Female, 94.8%
Fear 30.3%
Calm 19.1%
Confused 12.3%
Surprised 10.4%
Sad 10.2%
Happy 9.6%
Angry 6.7%
Disgusted 5.4%

AWS Rekognition

Age 28-38
Gender Male, 70.2%
Calm 62.9%
Sad 18.1%
Surprised 8.9%
Fear 6.3%
Confused 5.2%
Happy 4.6%
Angry 3%
Disgusted 2.6%

AWS Rekognition

Age 53-61
Gender Female, 85.3%
Calm 97.5%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Happy 0.5%
Disgusted 0.4%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 34-42
Gender Male, 100%
Calm 92.7%
Surprised 7.8%
Fear 6.3%
Sad 2.6%
Confused 0.7%
Happy 0.5%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 37-45
Gender Male, 64.7%
Calm 52.5%
Happy 13.2%
Sad 10.8%
Fear 9.2%
Disgusted 9%
Surprised 6.6%
Confused 3.2%
Angry 2.2%

AWS Rekognition

Age 21-29
Gender Female, 98.6%
Calm 96.7%
Surprised 6.5%
Fear 6.4%
Sad 2.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Male, 98.4%
Happy 76.8%
Calm 10.9%
Surprised 8.9%
Fear 6.4%
Sad 2.6%
Confused 1.9%
Disgusted 1.7%
Angry 1.4%

AWS Rekognition

Age 25-35
Gender Female, 80.8%
Sad 94.4%
Calm 51.6%
Surprised 6.4%
Fear 6%
Angry 0.5%
Happy 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-36
Gender Male, 87.4%
Calm 58.9%
Sad 22.5%
Fear 11.1%
Surprised 6.6%
Angry 3.8%
Disgusted 3.5%
Confused 3.1%
Happy 1.6%

Feature analysis

Amazon

Adult 97.6%
Male 97.6%
Man 97.6%
Person 97.6%
Baby 94.5%

Text analysis

Amazon

College
Art
and
(Harvard
Fellows
Museums)
of
University
Harvard
© President and Fellows of Harvard College (Harvard University Art Museums)
President
P1970.4520.0005
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4520.0005
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4520.0005