Human Generated Data

Title

The Honorable John Ross

Date

1766

People

Artist: Cosmo Alexander, British 1724 - 1772

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.127

Human Generated Data

Title

The Honorable John Ross

People

Artist: Cosmo Alexander, British 1724 - 1772

Date

1766

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.127

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 98.9
Painting 98.9
Human 98.2
Person 98.2

Clarifai
created on 2018-03-23

people 99.9
painting 98.3
adult 97.8
jacket 95.3
wear 93.2
one 92.7
furniture 92.5
portrait 92.5
leader 92.3
outerwear 91.5
seat 90.7
necklace 90.1
religion 88.8
lid 88.2
royalty 86.9
pants 86.8
man 86.1
two 85.8
coat 84.2
facial expression 84

Imagga
created on 2018-03-23

man 37.6
people 30.1
male 29.3
person 28.1
adult 25.8
portrait 25.2
family 22.2
grandma 22.1
senior 21.5
happy 21.3
home 19.9
elderly 18.2
old 17.4
lifestyle 17.3
human 17.2
fashion 16.6
couple 16.5
face 16.3
mature 15.8
grandfather 15.8
suit 15.7
lady 14.6
smiling 13.7
sitting 13.7
aged 13.6
dress 13.5
smile 13.5
room 12.8
ruler 12.6
happiness 12.5
retirement 12.5
interior 12.4
black 12.3
together 12.3
men 12
clothing 12
expression 11.9
father 11.9
mother 11.8
retired 11.6
boy 11.3
work 11.1
casual 11
two 11
grandmother 10.8
indoors 10.5
business 10.3
hair 10.3
love 10.3
cute 10
indoor 10
professional 9.9
handsome 9.8
tie 9.5
covering 9.3
attractive 9.1
child 9.1
chair 8.9
posing 8.9
businessman 8.8
computer 8.8
garment 8.7
sofa 8.6
model 8.6
living 8.5
executive 8.4
modern 8.4
hand 8.3
leisure 8.3
son 8.2
life 8.1
looking 8
worker 7.8
couch 7.7
elegant 7.7
pretty 7.7
relaxed 7.5
relationship 7.5
inside 7.4
parent 7.3

Google
created on 2018-03-23

portrait 93.4
painting 88.9
gentleman 85.9
art 76.9
modern art 53.2
picture frame 53
artwork 52.9

Microsoft
created on 2018-03-23

person 95.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Male, 91.4%
Surprised 5.3%
Angry 21.8%
Sad 4.2%
Calm 57%
Disgusted 3%
Confused 5.8%
Happy 2.9%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.9%
Person 98.2%

Categories