Human Generated Data

Title

Untitled (Borobudur, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5095

Human Generated Data

Title

Untitled (Borobudur, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5095

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Person 97.7
Art 94.9
Archaeology 94.7
Person 94.3
Baby 94.3
Person 92.5
Person 90
Baby 90
Person 89.9
Baby 89.9
Face 88.7
Head 88.7
Person 88.4
Baby 88.4
Person 88.2
Baby 88.2
Person 87.8
Person 84
Person 81.4
Person 81
Baby 81
Person 80.1
Baby 80.1
Person 77.7
Prayer 63.8
Person 61.8
Person 61.1
Person 61
Altar 57.2
Architecture 57.2
Building 57.2
Church 57.2
Painting 57
Temple 56.7
Shrine 55.7

Clarifai
created on 2018-05-10

people 99.8
illustration 99.1
engraving 98.7
man 98.7
print 98.1
art 97.6
group 97.3
many 95.3
etching 93.8
adult 92.4
visuals 89.1
antique 88.6
old 85.7
leader 85
soldier 84.7
weapon 83.7
war 82.8
vintage 81.3
chair 79.2
seat 78.5

Imagga
created on 2023-10-06

ancient 35.5
sculpture 33.8
old 32.7
stone 28.8
temple 27.7
history 27.7
art 26.3
religion 23.3
architecture 22.7
travel 22.5
stamp 22.1
carving 21.8
culture 21.4
statue 20.1
monument 19.6
money 19.6
vintage 15.7
tourism 15.7
god 15.3
currency 15.3
historic 14.7
cash 14.6
wall 14.5
finance 13.5
antique 13.4
religious 13.1
dollar 13
bank 12.9
wealth 12.6
paper 12.5
financial 12.5
bill 12.4
decoration 12
carved 11.7
business 11.5
retro 11.5
banking 11
bust 10.9
aged 10.9
postmark 10.8
symbol 10.8
spirituality 10.6
mail 10.5
historical 10.4
relief 10.3
close 10.3
east 10.3
letter 10.1
pay 9.6
die 9.4
nobody 9.3
savings 9.3
famous 9.3
speedway 9.1
card 9
philately 8.9
circa 8.9
ruins 8.8
heritage 8.7
dollars 8.7
us 8.7
exchange 8.6
face 8.5
rich 8.4
message 8.2
landmark 8.1
postage 7.9
civilization 7.9
postal 7.9
envelope 7.8
museum 7.8
holy 7.7
grunge 7.7
sign 7.5
traditional 7.5
one 7.5
facility 7.4
note 7.4
racetrack 7.3
ornate 7.3
detail 7.2
stencil 7.1
shaping tool 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

old 84.4
vintage 26.3
several 11.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 92.1%
Confused 91.2%
Surprised 6.4%
Fear 6.1%
Sad 3.6%
Calm 2.1%
Disgusted 1.4%
Angry 0.6%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Male, 99.5%
Fear 92.4%
Calm 12.7%
Surprised 6.9%
Sad 2.7%
Disgusted 2.2%
Happy 1.8%
Confused 1.1%
Angry 0.9%

AWS Rekognition

Age 20-28
Gender Male, 94.9%
Calm 90.8%
Surprised 8%
Fear 6%
Happy 3.8%
Sad 2.3%
Disgusted 0.8%
Confused 0.4%
Angry 0.4%

AWS Rekognition

Age 31-41
Gender Male, 96.5%
Sad 98.5%
Angry 33.1%
Surprised 6.9%
Happy 6.8%
Fear 6%
Calm 1.5%
Confused 0.7%
Disgusted 0.3%

AWS Rekognition

Age 10-18
Gender Female, 65.6%
Surprised 46.5%
Calm 46.2%
Happy 12.8%
Fear 6.2%
Sad 3.9%
Confused 2.6%
Disgusted 2.2%
Angry 1.4%

AWS Rekognition

Age 19-27
Gender Female, 100%
Sad 99.9%
Angry 16.7%
Surprised 6.4%
Fear 6.3%
Happy 1.4%
Calm 1.1%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99%
Calm 40.6%
Happy 23.5%
Sad 15.8%
Surprised 9.8%
Fear 7.3%
Disgusted 5.1%
Angry 4.8%
Confused 1.9%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Fear 98%
Surprised 6.3%
Sad 2.2%
Calm 0%
Angry 0%
Disgusted 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Fear 90.3%
Calm 13.3%
Surprised 7%
Sad 3.4%
Disgusted 2.4%
Confused 2.4%
Angry 1.9%
Happy 1%

AWS Rekognition

Age 26-36
Gender Male, 77.1%
Sad 99.9%
Calm 10.2%
Fear 8.2%
Surprised 6.9%
Disgusted 2.9%
Angry 2.4%
Confused 2.2%
Happy 1.3%

AWS Rekognition

Age 22-30
Gender Female, 100%
Sad 100%
Fear 7.4%
Surprised 6.3%
Confused 1.1%
Disgusted 0.6%
Calm 0.6%
Angry 0.4%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Male, 97.3%
Calm 94.9%
Surprised 6.4%
Fear 5.9%
Sad 3.4%
Disgusted 0.5%
Angry 0.5%
Confused 0.3%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 72.7%
Sad 98.2%
Angry 41.6%
Surprised 6.3%
Fear 6.3%
Happy 1.6%
Calm 0.6%
Disgusted 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Baby 94.3%

Categories

Imagga

paintings art 96.2%
nature landscape 2.3%

Captions