Human Generated Data

Title

Major General August de la Motte
Date

after 1787
People

Artist: John Singleton Copley, American 1738 - 1815
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Gordon Dexter, 1942.181

Human Generated Data

Title

Major General August de la Motte

People

Artist: John Singleton Copley, American 1738 - 1815

Date

after 1787

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Gordon Dexter, 1942.181

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 99.1
Hat 99.1
Apparel 99.1
Human 98.3
Person 98.3
Art 86.5
Pirate 76.6
Painting 61.5
Performer 59.8

Clarifai
created on 2018-03-16

people 100
lid 99.8
adult 99.1
wear 99.1
veil 98.6
one 98.4
man 97.3
outfit 97.2
portrait 97
retro 96.6
military 95.6
uniform 94.6
costume 94.3
painting 92.7
weapon 92.4
outerwear 92.4
jacket 91.9
coat 88.5
art 88
facial expression 86.3

Imagga
created on 2018-03-16

hat 100
cowboy hat 57.8
clothing 45
headdress 42.4
person 38
portrait 33
man 31.6
male 29.8
black 27
necktie 26.7
people 26.2
face 24.9
bow tie 23.8
adult 22.7
fashion 19.6
costume 18.9
cowboy 18.7
hand 18.2
model 17.9
handsome 16.9
hair 16.6
covering 16.6
smile 16.4
happy 16.3
consumer goods 16
guy 15.8
attractive 15.4
looking 15.2
senior 15
style 14.8
garment 13.9
expression 13.6
western 13.6
human 13.5
shirt 13.1
fun 12.7
look 12.3
oriental 12.1
men 12
one 11.9
dark 11.7
smiling 11.6
couple 11.3
sombrero 10.8
vintage 10.7
posing 10.7
lady 10.5
serious 10.5
wearing 10.5
sexy 10.4
boy 10.4
mature 10.2
casual 10.2
cute 10
retro 9.8
pretty 9.8
uniform 9.8
old 9.8
bolo tie 9.7
mysterious 9.7
outdoors 9.7
two 9.3
pose 9.1
romantic 8.9
kid 8.9
carnival 8.8
love 8.7
mystery 8.7
youth 8.5
head 8.4
elegance 8.4
worker 8.4
studio 8.4
make 8.2
eye 8
job 8
cowgirl 7.9
pirate 7.9
standing 7.8
party 7.7
child 7.7
elderly 7.7
suit 7.5
smoke 7.4
coat 7.4
emotion 7.4
entertainment 7.4
friendly 7.3
lifestyle 7.2
dress 7.2
women 7.1

Google
created on 2018-03-16

painting 90.1
portrait 87.7
art 83.9
gentleman 73.9
modern art 68.1
generalissimo 62.7
vintage clothing 54.4
monarch 50.9
artwork 50.8

Microsoft
created on 2018-03-16

person 98.9
man 92
wearing 87.2
hat 74.2
red 73
dressed 25

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 93.6%
Happy 3.8%
Surprised 5.3%
Disgusted 4.5%
Confused 3.1%
Angry 3.9%
Calm 68.1%
Sad 11.3%

Microsoft Cognitive Services

Age 64
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.1%
Person 98.3%
Painting 61.5%

Categories

Imagga

events parties 98%
people portraits 1.9%

Captions

Microsoft
created on 2018-03-16

a man wearing a red hat 89.5%
a man wearing a hat 89.4%
a man wearing a red and white hat 82.8%

Text analysis

Amazon

poml