Human Generated Data

Title

Captain Caleb Coggeshall (1758-1847)
Date

1808
People

Artist: William Dunlap, American 1766 - 1839
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.571

Human Generated Data

Title

Captain Caleb Coggeshall (1758-1847)

People

Artist: William Dunlap, American 1766 - 1839

Date

1808

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 97.3
Human 97.3
Clothing 96.1
Apparel 96.1
Art 85.7
Coat 76
Home Decor 63.5
Overcoat 63.1
Painting 62.4
Furniture 62.3
Wood 59.9

Clarifai
created on 2018-03-16

people 99.5
adult 99.4
one 99
woman 97.8
portrait 95.1
wear 94.8
painting 92.4
indoors 92.3
print 92.2
furniture 91.3
man 87.1
book series 86.8
book bindings 85.8
sit 85.7
education 85
writing 83.1
military 82.1
administration 80.8
facial expression 79.6
seat 79.5

Imagga
created on 2018-03-16

man 47
male 44.8
couple 38.3
grandma 36.6
senior 36.6
people 34
happy 32.6
portrait 31.1
grandfather 30.7
adult 28
family 27.6
person 26.9
elderly 26.8
home 26.3
lifestyle 23.9
smile 23.5
wife 22.8
smiling 22.4
mature 22.3
old 22.3
husband 21.9
together 20.2
casual 19.5
retired 18.4
love 18.1
bow tie 18.1
retirement 17.3
mother 15.8
human 15.7
father 15.2
executive 15.1
two 14.4
looking 14.4
married 14.4
boy 13.9
sitting 13.7
expression 13.6
handsome 13.4
necktie 13.1
director 13.1
grandmother 12.7
happiness 12.5
child 12.3
room 12.3
lady 12.2
face 12.1
attractive 11.9
son 11.8
loving 11.4
cheerful 11.4
togetherness 11.3
standing 11.3
men 11.2
older 10.7
indoors 10.5
sofa 10.5
pretty 10.5
life 10.1
aged 10
romantic 9.8
black 9.7
youth 9.4
parent 9.3
camera 9.2
suit 9.2
fashion 9
outdoors 9
daughter 8.9
businessman 8.8
60s 8.8
hugging 8.8
two people 8.8
hair 8.7
affectionate 8.7
couch 8.7
age 8.6
model 8.6
shirt 8.5
relationship 8.4
modern 8.4
garment 8.3
fun 8.2
romance 8
close 8
kid 8
business 7.9
cute 7.9
neck brace 7.7
tie 7.6
joy 7.5
office 7.5
one 7.5
confident 7.3
professional 7.1
interior 7.1

Google
created on 2018-03-16

painting 76.7
portrait 76
gentleman 71.2
vintage clothing 65.1
human behavior 62.2
art 59.2
picture frame 53.8

Microsoft
created on 2018-03-16

person 98

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 98.5%
Happy 0.9%
Calm 81.5%
Surprised 5.7%
Angry 3.6%
Confused 4.1%
Disgusted 1.6%
Sad 2.5%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Painting 62.4%

Captions

Microsoft

a person sitting in front of a window 75.2%
a person sitting on a table 75.1%
a person sitting at a table in front of a window 73.8%

Text analysis

Amazon

ont
zoh
t ont
Ct zoh
Ct
t