Human Generated Data

Title

A Two-Year-Old Girl Choked to Death Today on an Easter Egg
Date

1968
People

Artist: Ray Johnson, American 1927 - 1995
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Margaret Fisher Fund, M22692.B

Human Generated Data

Title

A Two-Year-Old Girl Choked to Death Today on an Easter Egg

People

Artist: Ray Johnson, American 1927 - 1995

Date

1968

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Margaret Fisher Fund, M22692.B

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.4
Human 99.4
Text 91.7
Art 85.6
Animal 75.6
Bird 75.6
Face 73.3
Painting 71
Portrait 60.8
Photography 60.8
Photo 60.8
Advertisement 60.6
Poster 60.4
Paper 57.5

Clarifai
created on 2018-02-09

people 98.2
adult 96.1
one 95.9
portrait 95.5
movie 94.3
retro 93.5
wear 90.6
man 89.8
music 84.7
art 83.7
administration 83
text 82.7
woman 81.2
sit 80.9
indoors 80.7
sign 80.4
actor 79.9
facial expression 79.1
theater 78.9
furniture 78.7

Imagga
created on 2018-02-09

photograph 63.2
representation 49.7
creation 42.5
statue 20.1
religion 15.2
black 15
one 14.9
sculpture 14.9
vintage 14.9
old 14.6
art 14.4
portrait 14.2
person 14.1
culture 13.7
necktie 13.7
memorial 13.6
man 12.8
face 12.8
book 12.5
product 12.5
business 12.1
ancient 12.1
people 11.7
brass 11.6
smile 11.4
office 11.2
religious 11.2
child 11
antique 10.4
figure 10.3
stone 10.3
symbol 10.1
male 9.9
envelope 9.8
historical 9.4
money 9.4
church 9.2
letter 9.2
historic 9.2
holding 9.1
decoration 8.8
paper 8.6
adult 8.4
monument 8.4
sign 8.3
closeup 8.1
history 8
success 8
circa 7.9
postmark 7.9
stamp 7.8
jacket 7.8
education 7.8
marble 7.7
sitting 7.7
attractive 7.7
mail 7.7
card 7.6
structure 7.6
dollar 7.4
lady 7.3
alone 7.3
global 7.3
currency 7.2
happiness 7

Google
created on 2018-02-09

photograph 95.6
text 88.2
black and white 70.7
font 64.9
picture frame 57.9
gentleman 56.2
vintage clothing 54.3
monochrome 51.8

Microsoft
created on 2018-02-09

businesscard 17.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Male, 99%
Calm 1.3%
Disgusted 1.3%
Angry 1.5%
Happy 91.9%
Confused 1.9%
Sad 1.2%
Surprised 1%

Microsoft Cognitive Services

Age 10
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Bird 75.6%

Captions

Microsoft
created on 2018-02-09

a vintage photo of a person 74.3%
a vintage photo of a person 67.8%
an old photo of a person 67.7%

Text analysis

Amazon

EASTER
DEATH
TODAY
EASTER EGG.
GIRL
TODAY ON AN
ON
AN
EGG.
CHOKED
A
A 2-YEAROL GIRL
CHOKED To DEATH
ay
2-YEAROL
To
ay Yohno
Yohno

Google

A 2- YEAR LGIRL CHOKED TO DEATH TODAY ON AN EASTER EGG.
A
2-
YEAR
LGIRL
CHOKED
TO
DEATH
TODAY
ON
AN
EASTER
EGG.