Human Generated Data

Title

Grins and Chuckles
Date

c. 1920-1950s
People

Artist: Felipe Jesus Consalvos, American 1891-c.1960
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Collection of Didi & David Barrett ‘71, 2011.43

Human Generated Data

Title

Grins and Chuckles

People

Artist: Felipe Jesus Consalvos, American 1891-c.1960

Date

c. 1920-1950s

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Collection of Didi & David Barrett ‘71, 2011.43

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Advertisement 99.6
Poster 99.6
Person 97.3
Human 97.3
Person 95.8
Person 94.4
Person 92.9
Person 91.1
Art 90
Person 85.3
Person 80.3
Collage 67.3
Person 61
Person 59.3
Person 59.1
Architecture 57.4
Building 57.4
Painting 56.8

Clarifai
created on 2018-03-23

illustration 99.2
people 98.6
painting 98.6
art 98.3
old 95.2
man 95
ancient 93.8
print 93.5
manuscript 93.3
lithograph 93.2
adult 92.7
religion 91.3
antique 90.5
vintage 90.1
group 87.9
street 85.5
woman 83.3
war 83.2
mural 82.9
retro 82.7

Imagga
created on 2018-03-23

prayer rug 67.1
rug 55.4
floor cover 40.3
furnishing 40.2
mosaic 38.9
art 38.2
jigsaw puzzle 32.3
covering 30.4
religion 26.9
puzzle 26.4
church 25
vintage 24.8
old 21.6
stamp 19.4
game 18.4
transducer 18.2
antique 17.8
letter 17.4
mail 17.2
post 17.2
postmark 16.8
postage 16.7
culture 16.3
comic book 15.9
icon 15.8
painted 15.3
design 15.2
pattern 15.1
religious 15
retro 14.8
postal 14.7
ancient 14.7
texture 14.6
electrical device 14.1
masterpiece 13.8
colorful 13.6
god 13.4
gold 13.2
decoration 13.2
detail 12.9
travel 12.7
museum 12.6
saint 12.5
printed 11.8
architecture 11.7
traditional 11.6
interior 11.5
symbol 11.5
unique 11.4
window 11.3
envelope 10.9
shows 10.8
renaissance 10.8
painter 10.8
paintings 10.8
delivery 10.7
communications 10.5
artistic 10.4
device 10.2
city 10
paint 10
stamps 9.9
tile 9.9
bible 9.8
style 9.6
office 9.6
faith 9.6
fine 9.5
golden 9.5
card 9.4
glass 9.3
artwork 9.2
global 9.1
book jacket 9.1
tourism 9.1
post mail 8.9
technology 8.9
canceled 8.9
zigzag 8.9
temple 8.9
fame 8.9
known 8.9
cutting 8.7
stained 8.7
scene 8.7
paper 8.6
close 8.6
finance 8.5
black 8.4
east 8.4
color 8.3
historic 8.3
currency 8.1
cathedral 8
colors 7.9
catholic 7.8
holy 7.7
wall 7.7
money 7.7
altar 7.6
oriental 7.6
one 7.5
economy 7.4
computer 7.2
collection 7.2
financial 7.1

Google
created on 2018-03-23

art 81.9
poster 71.5
tapestry 60.3
history 57.6
ancient history 54.3

Microsoft
created on 2018-03-23

text 98.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 50.2%
Disgusted 49.5%
Calm 49.6%
Angry 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.3%
Happy 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Angry 49.6%
Happy 50.1%
Surprised 49.7%
Sad 49.6%
Calm 49.6%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Happy 49.3%
Angry 45.3%
Confused 45.3%
Calm 49.1%
Sad 45.7%
Disgusted 45.1%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Male, 54%
Angry 45%
Sad 45.1%
Calm 45.5%
Disgusted 45%
Happy 54.1%
Surprised 45.1%
Confused 45%

AWS Rekognition

Age 48-68
Gender Male, 50.1%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Sad 50.3%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 48-68
Gender Male, 54%
Happy 45.2%
Calm 53.9%
Surprised 45.1%
Disgusted 45%
Angry 45.2%
Sad 45.4%
Confused 45.1%

AWS Rekognition

Age 27-44
Gender Female, 54.8%
Surprised 45.1%
Calm 45%
Sad 46.4%
Disgusted 45.1%
Angry 45.1%
Happy 53.4%
Confused 45%

AWS Rekognition

Age 38-57
Gender Male, 50.5%
Calm 49.5%
Confused 49.5%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.3%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.6%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Sad 50.4%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 53%
Disgusted 45%
Happy 45.2%
Surprised 45.1%
Confused 45.1%
Sad 45.4%
Calm 54.1%
Angry 45.1%

AWS Rekognition

Age 57-77
Gender Male, 50.4%
Angry 49.5%
Sad 50.4%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-53
Gender Male, 50.4%
Confused 49.5%
Sad 50.1%
Calm 49.7%
Disgusted 49.6%
Angry 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Calm 50.3%
Sad 49.5%
Surprised 49.5%

AWS Rekognition

Age 16-27
Gender Male, 50.5%
Surprised 49.6%
Angry 50%
Happy 49.5%
Disgusted 49.6%
Confused 49.6%
Calm 49.5%
Sad 49.7%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Sad 49.6%
Calm 49.5%
Happy 49.8%
Surprised 50%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Disgusted 49.9%
Confused 49.5%
Sad 50%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Happy 49.5%
Sad 49.6%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Confused 49.6%
Calm 50.2%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50.1%
Angry 49.5%
Calm 49.8%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 60-90
Gender Male, 54%
Happy 45.2%
Confused 45.6%
Calm 46.4%
Disgusted 45.5%
Sad 48.1%
Angry 48.9%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Sad 50.5%
Calm 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Male, 50.6%
Disgusted 45.1%
Confused 45%
Happy 45.2%
Calm 54.4%
Surprised 45.1%
Angry 45.1%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Angry 49.8%
Happy 45.1%
Surprised 45.7%
Sad 45.6%
Disgusted 45.2%
Calm 48.4%
Confused 45.3%

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.6%
Person 97.3%

Text analysis

Amazon

HOUSE
CLUB
HOLLYWOOD CLUB HOUSE
American (itizen
7
NICKI
HOLLYWOOD
10
-NICKI
HOME
NICKI-
ENICKI.
5
-NKI
NICKILSS
ISDIN
CHIEF
TOPICST
ENICKI
NICKI 5 NICKI- NICKI- 5
-NICKITHOIN
-INICKI- 5
-NICKI.
ICKI-
NICKILSS NICKI 5r NICKI -NICKI. S-NICKI-
IO1N -IH IS ISDIN TH6IN NICKI -INICKI- 5 -NICKITHOIN -IX5IN ENICKI. -NKI -NICKI ENICKI
MOVIES
MOVIES CHIEF MOvIes
-NICKE
S-NICKI-
ICKI- G)
MOvIes
ZepPeln
MOvieS
-IX5IN
TH6IN
Oviss
HoMe
IO1N
-IH IS
5r
177
c
G)
ZE VEGS
SSTMDIN-
e
KTe

Google

CLUB HOUSE HOLLYWOOD HOLLYWOOD mOVIES MOVIES TIMELY NICKI American (itizen NICKE HOLLYWOOD HOLLYWOOD
CLUB
HOUSE
HOLLYWOOD
mOVIES
MOVIES
TIMELY
NICKI
American
(itizen
NICKE