Human Generated Data

Title

Lewis Ashmun

Date

1822

People

Artist: Chester Harding, American 1792 - 1866

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of George P. Beech, 2007.84

Human Generated Data

Title

Lewis Ashmun

People

Artist: Chester Harding, American 1792 - 1866

Date

1822

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 98
Person 95.9
Human 95.9
Painting 93.5

Clarifai
created on 2018-03-23

people 99.9
portrait 99.8
adult 99.6
one 99.5
painting 98.3
wear 98.2
art 97.2
man 89.6
woman 86.5
side view 85.2
facial expression 83.7
retro 81.4
vintage 77.9
antique 74.1
music 73.3
necklace 73.3
profile 72.8
veil 70.7
old 70.6
dress 70.3

Imagga
created on 2018-03-23

chain mail 69.7
body armor 55.7
armor 42.5
protective covering 35.4
portrait 24.6
person 21.6
covering 20.7
adult 20.7
pretty 19.6
attractive 18.2
people 16.7
happy 16.3
child 16.2
hair 15.8
face 15.6
man 15.4
smile 15
sexy 14.4
skin 14.4
old 13.9
cute 13.6
lady 13
eyes 12.9
smiling 12.3
male 12.2
model 11.7
window screen 11.6
looking 11.2
lace 11
human 10.5
black 10.2
casual 10.2
head 10.1
vintage 9.9
screen 9.7
brunette 9.6
love 9.5
youth 9.4
book 9.3
kid 8.9
body 8.8
scarf 8.7
bride 8.6
expression 8.5
fashion 8.3
holding 8.2
one 8.2
sensual 8.2
handsome 8
close 8
lifestyle 7.9
paper 7.9
happiness 7.8
wall 7.7
texture 7.6
retro 7.4
stole 7.3
cheerful 7.3
art 7.3
wet 7.1

Google
created on 2018-03-23

photograph 95.6
portrait 95.4
lady 87.7
painting 86.7
picture frame 81.5
chin 76.9
vintage clothing 73.5
girl 66.1
art 62.8
impressionist 52.5

Microsoft
created on 2018-03-23

text 99.1
book 96.6
person 95.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 98.5%
Calm 72.2%
Sad 6.2%
Confused 4.4%
Disgusted 7.1%
Happy 0.9%
Surprised 3.2%
Angry 6%

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.9%
Painting 93.5%

Captions

Microsoft

a person holding a book 21.7%
a close up of a person 21.6%
a person taking a selfie 21.5%