Human Generated Data

Title

Untitled

Date

2003

People

Artist: Marcel Dzama, Canadian born 1974

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Margaret Fisher Fund, 2012.235

Human Generated Data

Title

Untitled

People

Artist: Marcel Dzama, Canadian born 1974

Date

2003

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Margaret Fisher Fund, 2012.235

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 95.9
Art 93.7
Drawing 91.2
Person 86.6
Sketch 72.5
Winter 71.5
Snow 71.5
Outdoors 71.5
Nature 71.5
Snowman 71.5
Flooring 69.6
Painting 65.1

Clarifai
created on 2018-02-10

woman 98.2
adult 93.9
people 93.1
illustration 91.7
wear 91.6
girl 90.9
art 90.6
man 90.1
dog 87.8
child 84.1
fun 83.2
motion 79.6
love 78.5
retro 77.8
sketch 77.6
recreation 76.7
one 75.5
action energy 74.6
enjoyment 72.4
dress 71.6

Imagga
created on 2018-02-10

snowman 36.9
silhouette 31.5
figure 29.4
art 23.3
cartoon 23.2
design 19.7
holiday 14.3
graphic 13.9
party 13.8
caribou 13.5
male 13.5
fun 13.5
love 13.4
people 12.8
happy 12.5
sport 12.4
man 12.1
wedding 12
creation 11.1
floral 11.1
deer 11
summer 10.9
giraffe 10.8
invitation 10.6
drawing 10.6
celebration 10.4
element 9.9
fashion 9.8
snow 9.5
frame 9.2
graphics 9.1
decoration 9.1
dress 9
card 8.6
bride 8.6
elegance 8.4
painting 8.4
greeting 8.4
heart 8.3
competition 8.2
artwork 8.2
pattern 8.2
celebrate 8.2
collection 8.1
group 8.1
boy 8
player 7.9
person 7.9
flower 7.7
grunge 7.7
winter 7.7
map 7.7
set 7.6
bag 7.6
dance 7.5
vintage 7.5
funny 7.4
cheerful 7.3
skate 7.3
black 7.2
women 7.1

Google
created on 2018-02-10

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-38
Gender Male, 90.2%
Sad 88.6%
Calm 5.2%
Disgusted 0.5%
Surprised 1.6%
Angry 2.1%
Happy 0.1%
Confused 1.7%

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Confused 6.1%
Angry 8.7%
Sad 13.6%
Calm 61.7%
Happy 0.2%
Disgusted 5.3%
Surprised 4.4%

Microsoft Cognitive Services

Age 56
Gender Male

Feature analysis

Amazon

Person 86.6%
Snowman 71.5%

Captions

Microsoft
created on 2018-02-10

a statue of a person 31.1%
a person in a costume 31%
a person sitting in a chair 18.6%