Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5035

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5035

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.1
Hat 99.1
Boy 98.6
Child 98.6
Male 98.6
Person 98.6
Male 98.6
Person 98.6
Adult 98.6
Man 98.6
Male 98.5
Person 98.5
Adult 98.5
Man 98.5
Male 97.5
Person 97.5
Adult 97.5
Man 97.5
Person 96.9
Person 95.8
Person 95.5
Person 95.5
Person 94.1
Person 93.4
Back 92.2
Body Part 92.2
Person 88.6
Male 88.6
Person 88.6
Adult 88.6
Man 88.6
Face 87.8
Head 87.8
Person 87.8
Person 87
Person 85.5
Person 82.6
Person 79.6
Cross 76.8
Symbol 76.8
Person 76.2
Person 76.2
Person 72.7
Person 72
Person 71.1
Outdoors 63.7
Person 61.6
Person 60.8
Gravestone 57.9
Tomb 57.9
People 57.9
Shorts 57.5
Sun Hat 55.7

Clarifai
created on 2018-05-10

people 99.9
group together 99
group 98.4
man 97.5
child 96.8
adult 96.5
many 95
woman 90.8
monochrome 89.3
military 87.8
boy 87.7
several 86.8
war 85.2
recreation 82.9
administration 82
wear 78.4
soldier 78.3
cavalry 77.2
five 73.3
crowd 70.7

Imagga
created on 2023-10-06

military uniform 39.3
statue 34.1
uniform 32.1
sculpture 29.6
clothing 25.3
world 20.1
travel 19.7
old 18.8
history 18.8
religion 17
consumer goods 16.6
art 16.3
people 16.2
man 16.1
architecture 15.6
covering 15.4
culture 15.4
stone 15.2
grandfather 15.2
building 14.3
kin 14.1
tourism 14
monument 14
ancient 13.8
sky 11.5
male 11.4
historical 11.3
antique 11.2
person 11.2
city 10.8
soldier 10.7
historic 10.1
landmark 9.9
vintage 9.9
park 9.9
portrait 9.7
adult 9.7
marble 9.7
fountain 9.6
symbol 9.4
parent 9.3
outdoor 9.2
traditional 9.1
child 9.1
black 9
mother 8.9
love 8.7
father 8.7
religious 8.4
outdoors 8.2
vacation 8.2
dad 8.1
decoration 8
lifestyle 7.9
urban 7.9
boy 7.8
sepia 7.8
heritage 7.7
summer 7.7
house 7.5
commodity 7.5
life 7.4
peace 7.3
girls 7.3
figure 7.2
family 7.1
helmet 7.1
day 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.2
outdoor 98.5
people 86.6
group 86.4
standing 84.7
old 76
mammal 51.6
posing 38.6
horse 16.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 88%
Sad 50.4%
Calm 38.8%
Angry 32.7%
Surprised 6.4%
Fear 6%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 90.2%
Sad 30.1%
Happy 20.9%
Calm 15.1%
Surprised 13.4%
Disgusted 12.9%
Fear 9.7%
Angry 7%
Confused 5.3%

AWS Rekognition

Age 10-18
Gender Female, 99.5%
Sad 75.8%
Surprised 26.6%
Confused 16%
Calm 10.5%
Fear 7.6%
Happy 6.9%
Disgusted 4.6%
Angry 3.5%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Sad 99.9%
Calm 12.9%
Surprised 6.5%
Fear 6.1%
Angry 2.7%
Confused 2.3%
Disgusted 1.7%
Happy 0.6%

AWS Rekognition

Age 13-21
Gender Male, 98.3%
Angry 48.7%
Calm 44.3%
Surprised 7%
Fear 6.1%
Sad 3.3%
Disgusted 1.3%
Happy 0.4%
Confused 0.3%

AWS Rekognition

Age 19-27
Gender Male, 92.6%
Calm 69.1%
Happy 15.6%
Surprised 7%
Angry 6.4%
Fear 6.2%
Sad 3.4%
Disgusted 2%
Confused 1.4%

AWS Rekognition

Age 18-26
Gender Male, 94.4%
Calm 81.7%
Surprised 7.8%
Fear 6.7%
Sad 3.4%
Disgusted 3.2%
Angry 2.9%
Happy 2.9%
Confused 0.9%

AWS Rekognition

Age 27-37
Gender Female, 72%
Happy 48.8%
Fear 38.9%
Calm 11.1%
Surprised 6.5%
Sad 2.9%
Angry 1.4%
Disgusted 0.9%
Confused 0.6%

AWS Rekognition

Age 20-28
Gender Male, 97.9%
Calm 98%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Female, 52.6%
Calm 60.4%
Fear 18.8%
Surprised 7%
Sad 5.8%
Happy 5.7%
Angry 2.9%
Disgusted 2.4%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Female, 64.6%
Fear 49.3%
Calm 20.7%
Surprised 13.5%
Angry 7.2%
Happy 5.9%
Sad 5.3%
Confused 5.1%
Disgusted 3.8%

AWS Rekognition

Age 16-22
Gender Female, 96.9%
Calm 58%
Disgusted 35%
Surprised 6.8%
Fear 6%
Sad 2.7%
Happy 1.6%
Confused 1.2%
Angry 1%

AWS Rekognition

Age 12-20
Gender Male, 79.2%
Sad 99.7%
Calm 16.8%
Surprised 7%
Fear 6.4%
Confused 6.3%
Disgusted 2.6%
Happy 1.9%
Angry 1.3%

Microsoft Cognitive Services

Age 10
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Boy 98.6%
Child 98.6%
Male 98.6%
Person 98.6%
Adult 98.6%
Man 98.6%