Human Generated Data

Title

Untitled (Borobudur, Java)
Date

January 26, 1960-February 2, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5103

Human Generated Data

Title

Untitled (Borobudur, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Rock 99.4
Wall 97.6
Archaeology 97.2
Soil 96.9
Brick 89.5
Animal 81.1
Bird 81.1
Sculpture 64.5
Art 64.5
Ruins 60.1
Statue 56.8

Clarifai
created on 2018-03-23

people 99.3
art 98.2
sculpture 97.8
man 95.3
ancient 94.2
adult 93.7
no person 93.7
group 93.6
statue 93.1
travel 88.9
religion 88
war 87.6
antique 85.1
many 84.4
old 84
archaeology 83.8
military 83.7
architecture 82.3
wear 81.4
stone 78.8

Imagga
created on 2018-03-23

wall 77.5
stone 60.2
brick 58.9
stone wall 55.3
structure 49.2
old 48.1
surface 45.9
texture 45.2
fence 44.4
pattern 39
architecture 38.5
rough 38.3
material 34.9
barrier 34.6
grunge 33.2
dirty 31.7
textured 31.6
cement 31.5
weathered 30.4
construction 30
aged 29.9
concrete 29.7
building 29.5
memorial 28.1
ancient 27.7
solid 25.2
brown 24.3
block 24.2
wallpaper 23.8
gravestone 22.8
obstruction 22.7
detail 22.5
vintage 22.3
exterior 22.1
rock 21.7
masonry 20.6
bricks 20.5
cracked 20.4
house 20.1
history 19.7
antique 19.2
stucco 17.2
close 17.1
backgrounds 17
building material 16.6
backdrop 16.5
design 16.3
gray 16.2
tile 16.1
retro 15.6
brickwork 14.8
cemetery 14.8
built 14.5
grungy 14.2
stones 14.2
urban 14
color 13.9
city 13.3
rubble 12.8
closeup 12.8
paint 12.7
blocks 12.7
stonewall 11.8
clay 11.7
aging 11.5
effect 11
decoration 10.8
worn 10.5
build 10.4
historical 10.4
strong 10.3
row 10.3
horizontal 10.1
frame 10
plaster 9.8
abandoned 9.8
pieces 9.7
broken 9.6
stain 9.6
rusty 9.5
outdoors 9
rectangle 8.8
architect 8.7
obsolete 8.6
black 8.4
yellow 8
wreck 7.9
granite 7.8
ruins 7.8
crack 7.8
rustic 7.7
orange 7.7
damaged 7.6
decorative 7.5
graffito 7.4
street 7.4
home 7.3
art 7.1

Google
created on 2018-03-23

black and white 91.9
archaeological site 87.5
ancient history 85.2
stone carving 84.3
monochrome photography 81.5
relief 79.1
history 77.5
monochrome 73.6
temple 71.5
rock 71.4
sculpture 66.7
carving 51.2
monument 51
ruins 50.2

Microsoft
created on 2018-03-23

rock 81.1
stone 8.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 72.1%
Disgusted 8.4%
Surprised 1.8%
Angry 6.9%
Sad 30.1%
Confused 4%
Happy 5.7%
Calm 43.1%

AWS Rekognition

Age 20-38
Gender Male, 74.9%
Disgusted 0.9%
Confused 3.6%
Angry 7.3%
Surprised 2.4%
Calm 12.6%
Happy 3%
Sad 70.1%

AWS Rekognition

Age 26-43
Gender Female, 59.4%
Sad 19.2%
Surprised 9.8%
Disgusted 2.4%
Confused 5%
Calm 52.3%
Happy 4%
Angry 7.3%

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Disgusted 7.8%
Confused 4.9%
Angry 9.4%
Surprised 6%
Happy 2.5%
Sad 12.5%
Calm 56.9%

AWS Rekognition

Age 26-43
Gender Male, 91.8%
Sad 10.7%
Calm 65.2%
Surprised 1.7%
Angry 8.4%
Disgusted 2.6%
Happy 1.4%
Confused 10.1%

AWS Rekognition

Age 26-43
Gender Male, 88.3%
Confused 2.3%
Sad 46.6%
Surprised 3.4%
Calm 31.5%
Happy 1%
Disgusted 2.2%
Angry 13.1%

AWS Rekognition

Age 26-43
Gender Male, 73.3%
Calm 65.9%
Disgusted 7.7%
Angry 4.9%
Surprised 4.7%
Confused 1.5%
Sad 13.8%
Happy 1.6%

AWS Rekognition

Age 45-63
Gender Male, 87.8%
Calm 64.4%
Disgusted 1.2%
Angry 18.7%
Happy 1.6%
Confused 3.6%
Sad 5.8%
Surprised 4.7%

AWS Rekognition

Age 26-43
Gender Female, 70%
Calm 6.5%
Disgusted 4.7%
Sad 56.4%
Angry 21.3%
Confused 1.9%
Surprised 2.9%
Happy 6.3%

Microsoft Cognitive Services

Age 46
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Bird 81.1%

Captions

Microsoft

an old photo of a rock 79.4%
a group of men sitting on a rock 48.8%
a person sitting on a rock 48.7%