Human Generated Data

Title

Giovanni Bertoja
Date

1897
People

Artist: Denman Waldo Ross, American 1853 - 1935
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.109.153

Human Generated Data

Title

Giovanni Bertoja

People

Artist: Denman Waldo Ross, American 1853 - 1935

Date

1897

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 96.2
Painting 89.9
Person 86.6
Human 86.6
Photography 55.1
Portrait 55.1
Face 55.1
Photo 55.1

Clarifai
created on 2020-04-23

people 99.1
portrait 98.9
one 96.9
painting 95.2
adult 93.6
man 91.8
woman 91.1
art 88.2
face 87.1
fashion 79.9
wear 76.8
hair 75.8
eye 74.6
facial expression 74.4
dark 70.2
retro 69.5
lid 67.4
old 66.5
bizarre 64.4
popularity 63.6

Imagga
created on 2020-04-23

portrait 45.3
face 44.8
hair 35.7
person 33.9
smile 33.5
wig 33.2
people 29.6
pretty 29.4
attractive 29.4
happy 28.9
blond 25.9
eyes 25.8
smiling 25.3
adult 25.2
hairpiece 25
skin 23.7
clothing 21.8
model 21
grandma 20.7
youth 20.5
cute 20.1
looking 20
attire 19.4
look 18.4
lips 17.6
expression 17.1
child 16.5
lady 16.2
natural 16.1
health 16
rustic 15.1
brunette 14.8
cheerful 14.6
sexy 14.5
head 14.3
mouth 14.1
mature 14
fashion 13.6
one 13.4
senior 13.1
studio 12.9
male 12.9
make 12.7
happiness 12.5
nose 12.4
care 12.4
makeup 12.3
lifestyle 12.3
teeth 12.1
close 12
friendly 11.9
casual 11.9
teenager 11.9
eye 11.6
elderly 11.5
closeup 11.5
man 11.4
healthy 11.3
women 11.1
brown 11.1
mother 11
handsome 10.7
stare 10.7
old 10.5
boy 10.4
love 10.3
joy 10
optimistic 9.8
grandmother 9.8
human 9.8
kid 9.8
fun 9.7
retirement 9.6
guy 9.4
glasses 9.3
teen 9.2
nice 9.2
pose 9.1
covering 8.8
age 8.6
joyful 8.3
alone 8.2
costume 8.2
sensual 8.2
lovely 8
posing 8
little 8
older 7.8
retired 7.8
sad 7.7
facial 7.7
clean 7.5
consumer goods 7.5
student 7.4
emotion 7.4
gorgeous 7.3
color 7.2
black 7.2

Google
created on 2020-04-23

Face 97.5
Portrait 97.3
Painting 96.5
Self-portrait 93.4
Cheek 92.7
Chin 91.1
Head 89
Forehead 84.6
Nose 84.2
Art 78.9
Watercolor paint 74.3
Jaw 73.5
Visual arts 59.3

Microsoft
created on 2020-04-23

painting 99.7
drawing 99.7
sketch 99.5
child art 96.9
person 96.4
art 94.2
portrait 87.9
human face 86.4
text 82.4
face 61.3
old 48.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 95.6%
Calm 35.3%
Fear 0.5%
Confused 1%
Disgusted 0.1%
Sad 62.5%
Happy 0%
Surprised 0.3%
Angry 0.4%

Microsoft Cognitive Services

Age 70
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 89.9%
Person 86.6%

Captions

Microsoft

a person posing for the camera 92.9%
a person wearing a white shirt and black hair 48.1%
a person looking at the camera 48%

Text analysis

Amazon

117
ne
ii ivrm' Berois ne 117
ivrm'
Berois
enman
ii

Google

vammi
vammi