Human Generated Data

Title

Untitled (Barong Dance, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5242

Human Generated Data

Title

Untitled (Barong Dance, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5242

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.9
Person 99.9
Person 99.7
Person 99
Person 98.8
Person 98.1
Person 97
Costume 93
Crowd 90.8
Building 83.4
Clothing 82.9
Apparel 82.9
Festival 82.9
People 75.5
Outdoors 75.1
Nature 72.7
Mammal 69.4
Animal 69.4
Horse 69.4
Urban 68.3
Plant 66
Tree 66
Architecture 61.8
Column 61.5
Stilts 61.5
Pillar 61.5
Face 61.3
Countryside 61.2
Accessory 60.5
Accessories 60.5
Sunglasses 60.5
Carnival 58
Tribe 57.1
Vegetation 56.8

Clarifai
created on 2018-03-23

people 100
group 99.8
many 99.3
adult 99.1
group together 98.1
wear 97.5
veil 97
man 96.5
woman 95.7
child 94.8
dancing 92.5
several 90.3
outfit 90.2
ceremony 85.9
facial expression 85.6
two 84.6
offspring 81.4
administration 80.9
home 80.8
dancer 78.9

Imagga
created on 2018-03-23

fountain 100
structure 77.5
statue 24
groom 19.5
dress 19
old 17.4
bride 16.4
sculpture 16.2
outdoor 16
people 15.1
person 14.8
man 14.8
travel 14.1
wedding 13.8
adult 13.6
two 13.5
park 12.3
outdoors 12
love 11.8
architecture 11.7
cemetery 11.6
tourism 11.5
stone 11.1
kin 11
art 10.9
city 10.8
religion 10.8
history 10.7
couple 10.4
ancient 10.4
building 10.3
culture 10.2
sky 10.2
day 10.2
landmark 9.9
marble 9.7
clothing 9.6
traditional 9.1
girls 9.1
fashion 9
human 9
water 8.7
happiness 8.6
face 8.5
male 8.5
black 8.4
monument 8.4
hair 7.9
grass 7.9
summer 7.7
tree 7.7
memorial 7.6
famous 7.4
historic 7.3
protection 7.3
romantic 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

outdoor 100
ground 98.5
person 85.8
people 77.3
sport 71.2
group 70.4
dancer 50.2
skirt 21.7
several 10

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-36
Gender Male, 55%
Angry 45.7%
Sad 47%
Calm 51.4%
Confused 45.7%
Surprised 45.1%
Happy 45%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 52.3%
Angry 52.6%
Surprised 45.1%
Happy 45%
Sad 45.2%
Calm 46.9%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Disgusted 45.2%
Happy 45.2%
Angry 45.8%
Surprised 45.3%
Sad 45.4%
Calm 52.8%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51.2%
Happy 45.1%
Calm 46.6%
Surprised 45.1%
Angry 45.9%
Confused 45.4%
Disgusted 45.1%
Sad 51.7%

AWS Rekognition

Age 26-43
Gender Male, 99.2%
Sad 1.8%
Disgusted 0.2%
Confused 0.5%
Surprised 0.5%
Calm 96.3%
Angry 0.6%
Happy 0.2%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Horse 69.4%
Sunglasses 60.5%