Human Generated Data

Title

The Five Senses

Date

1823

People

Artist: Louis-Léopold Boilly, French 1761 - 1845

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, George R. Nutter Fund, M20592

Human Generated Data

Title

The Five Senses

People

Artist: Louis-Léopold Boilly, French 1761 - 1845

Date

1823

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, George R. Nutter Fund, M20592

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 98.6
Person 98.6
Person 97.6
Person 92.2
Person 92.1
Art 89
Advertisement 85.8
Painting 83.5
Collage 81.4
Poster 81.4
People 70.5
Face 70.1
Text 67.1
Photo 64.4
Photography 64.4
Portrait 64.4
Person 61.7
Hair 57.7

Clarifai
created on 2019-11-10

people 98.8
group 97.6
woman 97.4
adult 97.4
man 97
child 95.7
portrait 94.6
family 94.1
love 94
son 93.7
retro 93
painting 92.4
wear 92.1
two 92.1
three 91.7
four 91.4
art 89.5
affection 89.2
togetherness 87.2
lithograph 86.1

Imagga
created on 2019-11-10

mother 83
parent 64.7
child 53.4
family 49.8
daughter 42.5
love 41.8
smiling 39.8
together 37.7
happy 37.6
people 35.7
father 35.4
male 33
man 30.9
couple 30.5
home 29.5
happiness 28.2
adult 25.3
dad 24.3
son 23.4
cheerful 22.8
portrait 22.7
boy 22.6
kid 22.2
smile 22.1
children 21.9
fun 21.7
lifestyle 21.7
brother 21.6
casual 20.3
group 20.2
joy 19.2
grandma 19.1
husband 18.6
two 16.9
room 16.8
indoors 16.7
cute 16.5
girls 16.4
30s 16.4
hug 15.5
kids 15.1
women 15
senior 14.1
loving 13.4
laughing 13.2
relationship 13.1
sitting 12.9
expression 12.8
parents 12.7
bonding 12.7
attractive 12.6
couch 12.6
childhood 12.5
married 12.5
sofa 12.4
interior 12.4
holding 12.4
wife 12.3
baby 12.2
face 12.1
pretty 11.9
mom 11.6
kin 11.5
playing 10.9
person 10.6
living 10.4
enjoying 10.4
looking 10.4
care 9.9
handsome 9.8
embracing 9.8
hugging 9.8
friends 9.4
youth 9.4
friendship 9.4
blond 9.3
joyful 9.2
dress 9
buddy 8.9
little 8.8
grandmother 8.8
embrace 8.8
grandfather 8.8
thirties 8.8
life 8.6
sit 8.5
pair 8.5
togetherness 8.5
horizontal 8.4
house 8.4
relaxing 8.2
romance 8
standing 7.8
parenthood 7.8
color 7.8
men 7.7
mid adult 7.7
generation 7.7
laugh 7.7
old 7.7
mature 7.4
camera 7.4
adorable 7.4
teenager 7.3
domestic 7.3
sibling 7.1
clothing 7

Google
created on 2019-11-10

People 94.3
Illustration 85.7
Art 82.2
Vintage clothing 77.4
Retro style 74.4
Painting 71.4
Family 58.3
Child 52

Microsoft
created on 2019-11-10

text 98.5
person 96.6
human face 96.2
drawing 95
clothing 89.3
smile 84.5
painting 74.8
sketch 72.5
cartoon 66.4
poster 52.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-65
Gender Female, 84.1%
Angry 0.1%
Sad 0.1%
Disgusted 0%
Fear 56.4%
Surprised 42.2%
Confused 1.1%
Happy 0.1%
Calm 0.1%

AWS Rekognition

Age 45-63
Gender Male, 95.1%
Angry 32.6%
Happy 0.7%
Sad 20.7%
Calm 16.4%
Fear 4.3%
Confused 1.7%
Disgusted 21.7%
Surprised 1.8%

AWS Rekognition

Age 8-18
Gender Female, 88.7%
Angry 1.1%
Surprised 23.2%
Sad 6.8%
Happy 4.7%
Disgusted 0.4%
Confused 3.2%
Calm 52.3%
Fear 8.3%

AWS Rekognition

Age 43-61
Gender Male, 72.3%
Angry 0.3%
Happy 0%
Disgusted 0%
Fear 0.1%
Calm 0.5%
Sad 98.9%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 51-69
Gender Male, 98.6%
Angry 0.4%
Happy 0.5%
Calm 90.1%
Surprised 0.5%
Disgusted 0%
Fear 0.1%
Sad 1.6%
Confused 6.7%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Painting 83.5%

Categories

Captions

Microsoft
created on 2019-11-10

a person holding a book 44.7%

Text analysis

Amazon

cing
cing sens.
sens.
soillty
0s:
Les
Drpeod
bnd
.T bnd dbe Drpeod
dbe
.T

Google

lah de lpech Los sens
lah
de
lpech
Los
sens