Human Generated Data

Title

James Gallatin (1796-1876)

Date

1837

People

Artist: George Linen, American 1802 - 1888

Previous attribution: Henry Inman, American 1801 - 1846

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.134

Human Generated Data

Title

James Gallatin (1796-1876)

People

Artist: George Linen, American 1802 - 1888

Previous attribution: Henry Inman, American 1801 - 1846

Date

1837

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.134

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 96.6
Human 93.7
Person 93.7
Painting 78.8

Clarifai
created on 2020-04-24

portrait 99.3
people 98.7
art 96.9
woman 96.1
one 95.4
light 90.5
adult 90
girl 88.2
no person 88.1
indoors 88
man 87.5
shadow 87
window 86.3
face 85.8
painting 83.7
music 83.7
moon 82.1
model 81.5
wear 81.3
street 80.3

Imagga
created on 2020-04-24

cloak 50.8
covering 39.8
face 35.5
black 34.8
portrait 34.3
person 32
eyes 29.3
phonograph record 29.2
adult 29.1
fashion 27.1
dark 26.7
model 22.5
attractive 22.4
hair 22.2
people 19.5
sexy 18.5
expression 17.9
lips 17.6
pretty 17.5
lady 16.2
sensual 15.5
youth 15.3
head 15.1
smile 14.2
man 14.1
looking 13.6
one 13.4
male 12.8
make 12.7
look 12.3
cute 12.2
brunette 12.2
makeup 11.9
skin 11.8
eye 11.6
posing 11.5
serious 11.4
lifestyle 10.8
happy 10.7
window 10.5
human 10.5
ethnic 10.5
hood 9.8
close 9.7
scary 9.7
mystery 9.6
women 9.5
closeup 9.4
smiling 9.4
hat 9.2
studio 9.1
sensuality 9.1
dress 9
religion 9
style 8.9
elegance 8.4
hand 8.4
gorgeous 8.2
handsome 8
clothing 8
witch 7.9
art 7.8
evil 7.8
horror 7.8
mysterious 7.8
culture 7.7
feminine 7.5
long 7.3
pose 7.2
fantasy 7.2
body 7.2
cool 7.1

Google
created on 2020-04-24

Portrait 75.3
Circle 66.4
Art 65.5
Space 54.2

Microsoft
created on 2020-04-24

human face 98.7
person 97.4
painting 90.5
art 88
text 59.2
clothing 57
colored 11.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Male, 92.1%
Fear 0.4%
Surprised 3.6%
Angry 1.3%
Sad 2.4%
Calm 88.2%
Happy 2.7%
Disgusted 0.9%
Confused 0.6%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.7%
Painting 78.8%

Categories

Captions