Human Generated Data

Title

Fall

Date

2006

People

Artist: Wendy Red Star, Apsáalooke born 1981

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Loren G. Lipson, M.D., 2018.188.1

Copyright

© Wendy Red Star

Human Generated Data

Title

Fall

People

Artist: Wendy Red Star, Apsáalooke born 1981

Date

2006

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Person 99.3
Human 99.3
Art 97.7
Painting 97.7
Apparel 96.8
Clothing 96.8
Leaf 73.8
Plant 73.8
Leisure Activities 71.8
Animal 71.4
Mammal 71.4
Tree 65.5
Festival 56.4
Crowd 56.4
Person 51.8

Clarifai
created on 2019-07-20

people 99.6
wear 99.4
adult 99.2
woman 98.1
painting 98
group 97.1
one 96.6
veil 94.6
print 94.3
facial expression 93
reclining 92.5
illustration 91.4
two 91.4
art 91.3
outfit 90.5
music 90.2
dress 89.2
enjoyment 88.9
daylight 87
flower 86.5

Imagga
created on 2019-07-20

jigsaw puzzle 30.2
puzzle 23.8
comic book 20.8
person 19.8
happy 19.4
game 18.1
people 17.8
autumn 14.9
colorful 14.3
decoration 13.7
tree 13.1
portrait 12.9
holiday 12.9
fashion 12.8
fall 12.7
color 12.2
adult 11.7
season 11.7
celebration 11.2
smiling 10.8
art 10.7
park 10.4
wall 10.3
culture 10.2
bright 10
traditional 10
celebrate 9.9
performer 9.8
attractive 9.8
old 9.7
grunge 9.4
yellow 9.3
religion 9
sexy 8.8
body 8.8
seasonal 8.7
leaves 8.7
festival 8.6
temple 8.6
golden 8.6
model 8.5
face 8.5
male 8.5
travel 8.4
outdoor 8.4
joy 8.3
dark 8.3
outdoors 8.3
print media 8.3
fun 8.2
style 8.2
man 8.1
romantic 8
posing 8
lifestyle 7.9
love 7.9
statue 7.9
smile 7.8
forest 7.8
outside 7.7
pretty 7.7
one 7.5
tourism 7.4
water 7.3
painting 7.2
trees 7.1
architecture 7

Google
created on 2019-07-20

Painting 89.6
Art 83.1
Visual arts 77.8
Illustration 66.9
Modern art 60.1

Microsoft
created on 2019-07-20

cartoon 88.2
drawing 87.4
person 76
art 70.9
clothing 68
poster 64.2
woman 53.7
colorful 52.9
painting 40.2
colored 10.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.4%
Calm 81.3%
Angry 1.9%
Confused 3.5%
Happy 0.1%
Disgusted 0.3%
Surprised 1%
Sad 11.9%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 97.7%

Captions

Microsoft

a painting of a person 73%
a person standing next to a painting 58%
a painting of a person 55.2%

Text analysis

Amazon

(II

Google

eane
S s eane
s
S