Human Generated Data

Title

Untitled (Borobudur, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5090

Human Generated Data

Title

Untitled (Borobudur, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5090

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Baby 98
Person 98
Baby 96.9
Person 96.9
Art 96.6
Baby 96.2
Person 96.2
Baby 96.2
Person 96.2
Baby 95.9
Person 95.9
Baby 95.3
Person 95.3
Person 95.1
Baby 94
Person 94
Person 87.6
Face 86.8
Head 86.8
Person 80.5
Person 78.2
Person 76.8
Person 74.9
Person 68.6
Archaeology 67.8
Architecture 57.6
Building 57.6
Temple 57.6
Prayer 55.8
Shrine 55.4
Painting 55.3

Clarifai
created on 2018-05-10

people 100
many 99.4
group 98.9
man 98.5
art 97.9
engraving 97.5
antique 94.3
old 92
crowd 91.4
ancient 91.1
adult 91.1
illustration 86
etching 85.3
vintage 84.6
empire 81.9
print 80.1
war 79.4
soldier 79
centennial 78.6
administration 75.1

Imagga
created on 2023-10-06

sculpture 36.9
daily 36.6
ancient 33.7
statue 32.6
stone 31.4
history 29.5
old 28.6
temple 26
art 25.8
religion 25.1
architecture 24.3
monument 23.3
travel 21.8
culture 19.6
carving 18.9
vintage 17.4
tourism 17.3
stall 16.4
famous 15.8
historic 15.6
antique 14.8
building 14.8
spirituality 14.4
column 13.8
newspaper 13.7
landmark 13.5
drawing 13.5
god 13.4
traditional 13.3
historical 12.2
religious 12.2
city 11.6
sketch 11.5
retro 11.5
product 10.8
marble 10.8
heritage 10.6
east 10.3
paper 10.2
facade 9.9
creation 9.8
spiritual 9.6
money 9.4
dollar 9.3
cash 9.1
decoration 9.1
aged 9
currency 9
one 9
carved 8.8
structure 8.8
past 8.7
holy 8.7
face 8.5
china 8.5
black 8.4
bank 8.2
representation 8.1
postmark 7.9
tomb 7.9
soldier 7.8
artistic 7.8
army 7.8
stamp 7.7
worship 7.7
wall 7.7
grunge 7.7
mail 7.7
tourist 7.6
church 7.4
letter 7.3
cemetery 7.3
world 7.3
kin 7

Google
created on 2018-05-10

black and white 90.3
text 86.2
structure 79.8
relief 79
history 79
stone carving 77.8
ancient history 76.7
monochrome photography 72.3
archaeological site 71.9
artwork 69.2
monochrome 67.3
stock photography 59.2
picture frame 56.4
art 52.6

Microsoft
created on 2018-05-10

old 69.9
bunch 47
different 37.8
several 17.6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 21-29
Gender Male, 98.3%
Sad 97.4%
Fear 14.4%
Angry 12.5%
Surprised 8.6%
Confused 6%
Calm 5.8%
Disgusted 3.3%
Happy 1.4%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 79%
Disgusted 8.7%
Surprised 7%
Fear 6.1%
Confused 3.9%
Sad 3.2%
Angry 2.3%
Happy 1.3%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 79%
Sad 10.8%
Surprised 6.8%
Confused 6.7%
Fear 6%
Angry 0.4%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 19-27
Gender Male, 97.1%
Calm 85.2%
Fear 8.4%
Surprised 6.8%
Sad 3%
Disgusted 2.3%
Angry 1.5%
Confused 1.4%
Happy 0.5%

AWS Rekognition

Age 23-33
Gender Female, 74.4%
Sad 100%
Calm 13.6%
Surprised 6.4%
Fear 6.3%
Disgusted 1%
Angry 0.7%
Confused 0.6%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Female, 80.3%
Calm 75.3%
Surprised 8.2%
Confused 7.3%
Fear 6.6%
Sad 5.6%
Angry 2.6%
Disgusted 1.8%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 88%
Sad 8.6%
Surprised 6.3%
Fear 6%
Happy 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 96.3%
Surprised 6.3%
Fear 5.9%
Sad 3.3%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Feature analysis

Amazon

Baby 98%
Person 98%

Categories

Imagga

paintings art 61.8%
streetview architecture 18.2%
beaches seaside 14.7%
nature landscape 3.7%

Captions

Microsoft
created on 2018-05-10

an old photo of a person 70.4%
a group of people sitting in a box 36.6%
an old photo of a store 36.5%