Human Generated Data

Title

Untitled A

Date

2008

People

Artist: Luo Brothers, Chinese

Publisher: Pace Editions, Inc., American

Publisher: Ethan Cohen Fine Arts,

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Richard Solomon and Ethan Cohen, 2010.474.1

Human Generated Data

Title

Untitled A

People

Artist: Luo Brothers, Chinese

Publisher: Pace Editions, Inc., American

Publisher: Ethan Cohen Fine Arts,

Date

2008

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Advertisement 99
Human 98.5
Person 98.5
Collage 97.8
Person 96.6
Person 96.5
Brochure 91.9
Flyer 91.9
Paper 91.9
Vacation 89.1
Poster 85.4
Tourist 70.8
Text 64.4
Leisure Activities 62.4
Person 61.5
People 60.6
Label 59.5
Person 49.3
Person 44.3

Clarifai
created on 2018-02-09

illustration 98.2
art 95.3
celebration 94.4
woman 93.4
vector 92.9
traditional 92.7
fun 92
man 91.8
child 91.4
costume 90.6
graphic 90.4
collage 90.3
music 89.5
people 89
sketch 87.4
dancing 87.3
entertainment 86.7
desktop 86.4
culture 84.8
character 84.3

Imagga
created on 2018-02-09

art 38
treasury 36.9
depository 29.9
facility 22.6
design 21.4
cartoon 21.4
colorful 17.9
decoration 16.7
moon 15.9
happy 15.7
party 15.5
flower 14.6
dance 13.9
drawing 13.7
graphic 13.1
card 12.9
smile 12.8
frame 12.8
floral 12.8
child 12.8
cute 12.2
altar 12.1
celebration 12
funny 11.9
color 11.7
retro 11.5
people 11.2
culture 11.1
creation 10.5
fun 10.5
pattern 10.3
artwork 10.1
holiday 10
traditional 10
religion 9.9
texture 9.7
animal 9.3
person 9.3
bird 9.3
yellow 9.3
silhouette 9.1
vintage 9.1
painting 9
style 8.9
kid 8.9
symbol 8.7
paper 8.7
boy 8.7
artistic 8.7
structure 8.7
ornament 8.6
postcard 8.6
happiness 8.6
season 8.6
leaf 8.6
black 8.4
year 8.2
man 8.1
group 8.1
childhood 8.1
decor 8
antique 8
icon 7.9
costume 7.9
text 7.9
flowers 7.8
face 7.8
portrait 7.8
grunge 7.7
character 7.5
joy 7.5
church 7.4
letter 7.3
paint 7.2
family 7.1

Google
created on 2018-02-09

pink 94.7
poster 82.8
art 59.7
album cover 52.7
advertising 51.3
dancer 50.7
magenta 50.3
fun 50.3

Microsoft
created on 2018-02-09

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 75.2%
Sad 3%
Disgusted 1.4%
Surprised 2.2%
Calm 84.8%
Angry 1.5%
Happy 4.5%
Confused 2.7%

AWS Rekognition

Age 35-52
Gender Male, 77.6%
Happy 11.2%
Angry 4.4%
Disgusted 2.7%
Calm 68.8%
Sad 1.7%
Surprised 4.7%
Confused 6.6%

AWS Rekognition

Age 35-52
Gender Male, 87%
Happy 1.1%
Sad 0.6%
Confused 2.4%
Angry 0.8%
Surprised 1.4%
Calm 93.3%
Disgusted 0.4%

AWS Rekognition

Age 23-38
Gender Female, 99.4%
Surprised 16%
Angry 6.4%
Happy 27.3%
Sad 7%
Disgusted 5.6%
Confused 4.8%
Calm 32.9%

AWS Rekognition

Age 23-38
Gender Female, 99.6%
Sad 1%
Calm 6.1%
Confused 2.5%
Angry 1%
Happy 84.8%
Disgusted 1.1%
Surprised 3.6%

AWS Rekognition

Age 23-38
Gender Female, 90.4%
Happy 21.2%
Disgusted 3.8%
Calm 13.2%
Surprised 28.2%
Sad 9.2%
Confused 5.2%
Angry 19.2%

AWS Rekognition

Age 30-47
Gender Female, 50.5%
Calm 49.5%
Surprised 49.5%
Sad 50.5%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Happy 52.3%
Confused 45.1%
Disgusted 45%
Sad 47.3%
Angry 45.1%
Calm 45.1%
Surprised 45.1%

AWS Rekognition

Age 23-38
Gender Female, 99.7%
Sad 0.5%
Disgusted 1.2%
Surprised 3.1%
Calm 10.1%
Angry 1.2%
Happy 83%
Confused 1%

AWS Rekognition

Age 26-43
Gender Female, 88.4%
Confused 4.6%
Sad 2.3%
Surprised 7.5%
Angry 3.3%
Calm 8.9%
Happy 71%
Disgusted 2.4%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Poster 85.4%

Captions

Microsoft

a group of kids posing for a photo 64.5%
a group of people posing for a photo 64.4%
a group of women posing for a photo 64.3%

Text analysis

Amazon

ua>ui
t