Human Generated Data

Title

Untitled (Barong Dance, Bali)
Date

February 2, 1960-February 17, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2345
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Barong Dance, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.8
Human 99.8
Person 99.3
Person 97.6
Clothing 95.7
Apparel 95.7
Face 91.1
Crowd 82.3
Head 66.2
Photo 64.4
Portrait 64.4
Photography 64.4
Blonde 63.2
Female 63.2
Teen 63.2
Girl 63.2
Child 63.2
Woman 63.2
Kid 63.2
Finger 62.8
Hair 60.3
Festival 59.6
Skin 59
Undershirt 58.9
Costume 55.8
Hat 54.6

Clarifai
created on 2018-03-23

people 99.9
child 98.9
adult 98.1
wear 98.1
group 98
portrait 98
two 97.4
facial expression 97.3
veil 95.4
offspring 94.7
three 94.3
woman 93.4
son 92.1
one 91.7
four 89.5
actress 88.3
man 85.9
sibling 85.8
outfit 85.5
group together 84.7

Imagga
created on 2018-03-23

child 63.7
portrait 33.6
person 31.7
face 26.3
people 26.2
happy 24.4
smile 24.2
adult 23.3
son 22.3
cute 22.2
fashion 21.9
hat 21.5
happiness 21.2
pretty 21
hair 20.6
attractive 20.3
model 20.2
male 20
dress 19.9
kid 18.6
sexy 18.5
brother 17.1
sibling 16.7
women 15.8
blond 15.6
eyes 14.6
smiling 14.5
childhood 14.3
one 14.2
parent 13.8
fun 13.5
love 13.4
lady 13
girls 12.8
look 12.3
mother 12
body 12
joy 11.7
family 11.6
little 11.5
cheerful 11.4
brunette 11.3
human 11.2
father 11.2
looking 11.2
clothing 11.1
world 10.8
posing 10.7
baby 10.5
style 10.4
youth 10.2
dad 10.1
daughter 9.8
bride 9.6
doll 9.4
costume 9.1
black 9
retro 9
life 8.9
lovely 8.9
standing 8.7
toddler 8.6
two 8.5
elegance 8.4
dark 8.4
vintage 8.3
outdoors 8.2
playing 8.2
children 8.2
sensual 8.2
gorgeous 8.2
man 8.1
interior 8
offspring 7.9
together 7.9
play 7.8
modern 7.7
outside 7.7
expression 7.7
females 7.6
lips 7.4
plaything 7.3
crown 7.3
sensuality 7.3
make 7.3
headdress 7.2
holiday 7.2
handsome 7.1

Google
created on 2018-03-23

people 96
photograph 95.9
black 95.3
black and white 91.3
lady 85.6
monochrome photography 82.4
girl 82.3
photography 82
snapshot 81.8
smile 76.5
fun 72.1
human 69.9
monochrome 67.2
family 66.4
vintage clothing 63.8
happiness 60.3
portrait photography 56.7
ceremony 50.9
child 50.6

Microsoft
created on 2018-03-23

person 86.7
dancer 57.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-25
Gender Female, 100%
Disgusted 2%
Calm 83.6%
Happy 4.7%
Angry 1.6%
Sad 6.5%
Confused 1%
Surprised 0.6%

AWS Rekognition

Age 14-23
Gender Female, 93.2%
Calm 32.6%
Disgusted 1.2%
Sad 51.2%
Angry 2.7%
Confused 3.5%
Surprised 1.4%
Happy 7.3%

AWS Rekognition

Age 48-68
Gender Female, 75.2%
Surprised 31.5%
Happy 8.9%
Disgusted 2.7%
Calm 26.5%
Confused 4.4%
Angry 5.1%
Sad 21%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 54.6%

Captions

Microsoft

an old photo of a person 89.4%
a person wearing a hat 84%
a person wearing a black hat 80.2%