Human Generated Data

Title

Portrait of a Young Blond Boy
Date

19th-20th century
People

Artist: Denman Waldo Ross, American 1853 - 1935
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.187

Human Generated Data

Title

Portrait of a Young Blond Boy

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

19th-20th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 96.5
Head 86.2
Human 82.8
Person 82.8
Text 76.8
Mural 67.4
Painting 65.2
Wall 60.9
Face 58.2

Clarifai
created on 2018-03-23

people 99.4
portrait 97
person 95.5
popularity 93.9
one 93
adult 90.6
man 89.3
face 89.1
wear 88.7
famous 87.8
pop 83.6
talent 82.1
child 76.2
event 75.8
outdoors 75.1
color 74.9
hair 74.4
entertainment 73.6
facial expression 70.6
nature 69.1

Imagga
created on 2018-03-23

grandma 52.7
portrait 44.7
person 34.5
beard 34.4
face 34.1
people 30.1
senior 29.1
hair 27
adult 26.5
happy 25.1
smile 22.8
mature 22.3
man 21.5
male 21.4
child 20.9
looking 20.8
expression 20.5
old 20.2
happiness 19.6
elderly 19.2
grandmother 18.6
eyes 18.1
one 17.9
lady 17.9
smiling 17.4
human 16.5
outdoors 16.4
casual 16.1
pretty 16.1
look 15.8
model 15.6
attractive 15.4
cheerful 14.6
garden 14.3
friendly 13.7
retirement 13.4
park 13.2
close 13.1
lifestyle 13
cute 12.9
aged 12.7
healthy 12
youth 11.9
mother 11.9
retired 11.6
skin 11.6
handsome 11.6
age 11.4
boy 11.3
closeup 10.8
aging 10.5
love 10.3
life 10.3
glasses 10.2
blond 10.1
joy 10
children 10
outdoor 9.9
posing 9.8
braid 9.8
sitting 9.4
head 9.2
emotion 9.2
girls 9.1
modern 9.1
health 9
pensioner 9
fun 9
childhood 9
older 8.7
affection 8.7
facial 8.6
men 8.6
clothing 8.4
teen 8.3
shirt 8.2
pose 8.2
sexy 8
family 8
women 7.9
elder 7.9
rustic 7.9
couple 7.8
daughter 7.8
single 7.4
sunscreen 7.1

Google
created on 2018-03-23

portrait 94.4
painting 92.8
head 85.9
watercolor paint 76.2
art 73
impressionist 70
vintage clothing 60.7
self portrait 60.6
paint 60.1
child 58.5
smile 53.5
artwork 53.4

Microsoft
created on 2018-03-23

tree 97.6
person 96.7
man 95.2
old 56.5
older 22.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Female, 98.8%
Calm 9.8%
Disgusted 1.7%
Sad 9.8%
Angry 4%
Confused 5%
Surprised 67.4%
Happy 2.3%

Microsoft Cognitive Services

Age 80
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 82.8%
Painting 65.2%

Captions

Microsoft

a man wearing a suit and tie 91.5%
a person posing for the camera 91.4%
a man wearing a blue shirt 70.3%

Text analysis

Amazon

lL