Human Generated Data

Title

Portrait of a Young Man in a White Shirt

Date

1920s

People

Artist: John Calvin Stevens, American 1855 - 1940

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Dr. Denman W. Ross, Class of 1875, 1936.109.123

Human Generated Data

Title

Portrait of a Young Man in a White Shirt

People

Artist: John Calvin Stevens, American 1855 - 1940

Date

1920s

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 96.8
Head 92.2
Painting 86.4
Human 85.4
Person 85.4
Face 77.7

Clarifai
created on 2020-04-23

art 99.6
painting 99.2
people 99.1
portrait 98.9
one 98.8
man 96.9
sculpture 95.5
facial hair 95.5
adult 94.8
face 90.6
nude 87.9
ancient 87.8
woman 86.7
wear 80.1
old 78.5
veil 78.2
profile 75.8
Renaissance 73.7
no person 70.6
artistic 70.2

Imagga
created on 2020-04-23

man 41
portrait 40.1
person 37.8
face 37.7
bust 35.6
sculpture 34.8
male 30.5
handsome 25.9
hair 25.4
adult 25.2
expression 23.9
people 23.4
senior 22.5
one 22.4
mature 22.3
looking 21.6
plastic art 21.1
head 21
old 18.8
smile 18.5
serious 18.1
black 16.8
happy 16.3
art 15.9
human 15.8
attractive 15.4
elderly 15.3
closeup 14.8
model 14.8
ruler 14.8
eyes 14.6
close 14.3
guy 13.9
smiling 13
skin 12.5
mug shot 12.3
retirement 11.5
age 11.4
boy 11.3
men 11.2
retired 10.7
nose 10.7
emotion 10.1
figure 10.1
gray 9.9
pretty 9.8
sexy 9.6
statue 9.5
photograph 9.5
love 9.5
casual 9.3
confident 9.1
fashion 9
eye 8.9
success 8.9
look 8.8
older 8.7
lifestyle 8.7
thinking 8.6
studio 8.4
joy 8.4
health 8.3
alone 8.2
aged 8.1
grandfather 8
beard 7.9
representation 7.8
facial 7.7
adolescent 7.6
dark 7.5
outdoors 7.5
glasses 7.4
successful 7.3
cheerful 7.3
lady 7.3
life 7.3
women 7.1

Google
created on 2020-04-23

Face 97.9
Portrait 95
Painting 93.6
Chin 93.4
Cheek 91.6
Forehead 90.5
Head 90.4
Self-portrait 88.4
Nose 87
Art 83.9
Jaw 78.3
Neck 65.4
Visual arts 59.3
Drawing 51.1

Microsoft
created on 2020-04-23

drawing 99.1
painting 99
sketch 98.4
text 97.9
art 97.4
human face 97
man 92.3
portrait 89.6
person 88.3
old 74
face 60.8
older 22

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 96.8%
Disgusted 0.1%
Happy 0%
Angry 0.3%
Sad 0.4%
Confused 0.3%
Surprised 2.7%
Fear 0.2%
Calm 96%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 86.4%
Person 85.4%

Captions

Microsoft

a man looking at the camera 67.7%
a man wearing a suit and tie 67.6%
a close up of a man 67.5%