Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5044

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5044

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Adult 98.5
Male 98.5
Man 98.5
Person 98.5
Adult 98.3
Male 98.3
Man 98.3
Person 98.3
People 98.3
Person 98
Person 97.8
Person 97.7
Person 97.1
Person 97.1
Adult 96.8
Person 96.8
Bride 96.8
Female 96.8
Wedding 96.8
Woman 96.8
Person 96.2
Plant 95.8
Vegetation 95.8
Person 94.7
Tree 94.4
Person 93.6
Person 92.7
Person 92.5
Clothing 91.3
Person 89.9
Person 89.2
Person 88.4
Face 87.6
Head 87.6
Person 82.5
Outdoors 81.1
Shorts 78.6
Nature 74.3
Person 73.4
Person 71.1
Crowd 67.5
Person 66.2
Hat 65.5
Land 62.6
Woodland 62.6
Photography 57.9
Hippie 57.4

Clarifai
created on 2018-05-10

people 100
child 98.6
group 98
many 97.3
adult 97.1
group together 96.7
man 95.5
woman 94.8
war 94.2
military 91.3
boy 90.4
administration 87.5
soldier 86.3
family 84
crowd 83.2
recreation 80.1
wear 78.7
skirmish 73.7
street 72.9
uniform 71.9

Imagga
created on 2023-10-06

snow 61.2
winter 43.4
cold 31.9
park 29.6
tree 25.4
landscape 23.8
weather 22.9
forest 21.8
season 21
frost 20.2
ice 19.2
outdoors 18.3
trees 16.9
snowy 16.5
scene 16.4
outdoor 16.1
old 16
sky 15.9
covered 13.6
light 13.4
city 13.3
frozen 12.4
people 12.3
structure 12
architecture 11.7
man 11.4
statue 11.1
street 11
peaceful 11
building 10.8
road 10.8
snowing 10.8
groom 10.7
walk 10.5
couple 10.5
fountain 10.1
blizzard 9.9
travel 9.9
snowfall 9.8
mountain 9.8
frosty 9.8
night 9.8
scenic 9.7
seasonal 9.6
kin 9.6
black 9.6
love 9.5
town 9.3
person 9.2
wood 9.2
historic 9.2
fall 9.1
stone 9.1
fun 9
water 8.7
freeze 8.5
row 8.4
branch 8.2
river 8
rural 7.9
urban 7.9
day 7.8
wall 7.8
pedestrian 7.8
storm 7.7
residential 7.7
two 7.6
path 7.6
garden 7.5
world 7.4
mountains 7.4
spectator 7.3
calm 7.3
chemical weapon 7.3
girls 7.3
scenery 7.2
holiday 7.2
mother 7.1
family 7.1
cool 7.1
country 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

tree 99
outdoor 98.1
person 97.9
group 89
posing 82.4
old 78.6
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Confused 56%
Calm 40.5%
Surprised 6.4%
Fear 6%
Sad 3%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 100%
Sad 91.5%
Calm 53.5%
Surprised 6.4%
Fear 6%
Confused 1.6%
Disgusted 0.6%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Sad 99.2%
Confused 33.9%
Surprised 6.4%
Fear 6%
Calm 4.7%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 96.3%
Sad 99.1%
Calm 29.9%
Surprised 7.3%
Fear 6.3%
Angry 2.7%
Confused 2.3%
Disgusted 1.3%
Happy 0.9%

AWS Rekognition

Age 40-48
Gender Female, 99.6%
Sad 100%
Calm 7.1%
Fear 6.9%
Surprised 6.4%
Confused 0.9%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 96.4%
Calm 60.6%
Sad 19.5%
Surprised 9.7%
Happy 7.1%
Fear 6.1%
Confused 4.3%
Disgusted 3%
Angry 2.1%

AWS Rekognition

Age 22-30
Gender Male, 95.1%
Confused 63.3%
Calm 17.6%
Surprised 9.5%
Sad 8.9%
Fear 6.2%
Disgusted 1.5%
Happy 0.6%
Angry 0.5%

AWS Rekognition

Age 23-31
Gender Female, 62%
Sad 94.8%
Calm 27.5%
Surprised 9.9%
Angry 9.7%
Fear 6.3%
Disgusted 5.1%
Confused 2.4%
Happy 1.3%

AWS Rekognition

Age 23-33
Gender Male, 86.3%
Sad 56.4%
Surprised 41.8%
Confused 25.1%
Calm 7.4%
Fear 6.4%
Happy 5.8%
Disgusted 2.9%
Angry 1.3%

AWS Rekognition

Age 12-20
Gender Male, 98.4%
Calm 63.9%
Happy 30%
Surprised 6.6%
Fear 5.9%
Sad 3.5%
Confused 0.9%
Disgusted 0.8%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 90.1%
Sad 71.1%
Calm 66.4%
Surprised 6.3%
Fear 5.9%
Angry 0.3%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 7-17
Gender Female, 73.2%
Calm 66.2%
Fear 16.5%
Surprised 7.2%
Sad 6.3%
Confused 2.2%
Disgusted 2.1%
Happy 1.6%
Angry 1.1%

AWS Rekognition

Age 16-22
Gender Female, 64.3%
Calm 74.2%
Sad 35.1%
Surprised 6.4%
Fear 5.9%
Angry 1.1%
Happy 0.9%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Male, 76.8%
Calm 50.3%
Angry 31.5%
Surprised 13.2%
Fear 6.2%
Sad 3.5%
Happy 2.1%
Disgusted 1.5%
Confused 0.8%

AWS Rekognition

Age 16-22
Gender Female, 99.6%
Sad 52%
Disgusted 34.5%
Angry 11.5%
Fear 9.8%
Surprised 7.8%
Happy 7.7%
Calm 6.1%
Confused 1.9%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98.5%
Male 98.5%
Man 98.5%
Person 98.5%
Bride 96.8%
Female 96.8%
Woman 96.8%
Shorts 78.6%