Human Generated Data

Title

Untitled (Barong Dance, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5237

Human Generated Data

Title

Untitled (Barong Dance, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5237

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Shorts 99.8
Apparel 99.8
Clothing 99.8
Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.4
Person 99.3
Person 98.8
Person 98.6
Person 95
People 83.9
Swimwear 80.5
Play 78.2
Nature 73.5
Outdoors 70.1
Bikini 68.2
Person 66.8
Face 64.5
Child 62
Kid 62
Female 60.4
Girl 60.1
Barefoot 58.2
Tree 57.2
Plant 57.2
Team 56.9
Sports 56.9
Sport 56.9
Team Sport 56.9
Volleyball 56.9
Urban 55.5
Person 42.6

Clarifai
created on 2018-03-23

people 100
group together 99.9
many 99.9
group 99.8
adult 99.2
several 98.8
man 96.1
two 94.2
child 93.5
three 93.1
wear 91.8
four 91.2
administration 91
leader 90.1
military 89.7
five 89.1
one 87.2
war 87.2
vehicle 83.9
interaction 83

Imagga
created on 2018-03-23

snow 100
weather 60.9
winter 20.4
outdoor 18.3
tree 17.7
park 16.5
outdoors 15.8
cold 15.5
people 14.5
beach 13.7
mother 13.7
parent 13.6
bench 13.5
landscape 13.4
forest 13.1
child 12.9
man 12.1
travel 12
old 11.8
season 11.7
trees 11.6
sky 11.5
water 11.3
fun 11.2
park bench 10.9
kin 10.4
wood 10
vacation 9.8
sand 9.8
snowy 9.7
summer 9.6
frozen 9.6
sea 9.4
joy 9.2
frost 8.6
walk 8.6
seat 8.4
city 8.3
ice 8.3
women 7.9
father 7.8
scene 7.8
men 7.7
statue 7.6
relax 7.6
walking 7.6
leisure 7.5
light 7.4
sport 7.2
black 7.2
history 7.2
male 7.1
happiness 7.1
autumn 7

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

outdoor 99.8
ground 96.2
person 89
old 48.2
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 16-27
Gender Female, 50.2%
Confused 45.1%
Sad 45.6%
Angry 45.2%
Calm 45.2%
Happy 53.5%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 23-38
Gender Male, 54.2%
Angry 53.4%
Disgusted 46%
Happy 45.1%
Sad 45%
Calm 45.4%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 23-38
Gender Female, 50.6%
Confused 45.3%
Surprised 45.1%
Happy 45.1%
Angry 47.4%
Disgusted 45.6%
Sad 49.9%
Calm 46.6%

AWS Rekognition

Age 26-43
Gender Male, 59.8%
Happy 1.3%
Disgusted 11.9%
Surprised 3.7%
Calm 60.7%
Angry 7.8%
Sad 9%
Confused 5.6%

AWS Rekognition

Age 16-27
Gender Male, 54.7%
Disgusted 47.8%
Confused 45.3%
Calm 46.3%
Surprised 45.4%
Angry 46.3%
Sad 45.3%
Happy 48.6%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Disgusted 45.4%
Surprised 45.5%
Angry 52.1%
Sad 45.3%
Confused 45.5%
Happy 45.2%
Calm 46%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Surprised 49.6%
Confused 49.5%
Disgusted 49.6%
Calm 49.8%
Angry 49.6%
Sad 49.7%
Happy 49.5%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Feature analysis

Amazon

Person 99.7%

Text analysis

Amazon

T