Human Generated Data

Title

Col. Dudley Colman (1745-1797)
Date

c. 1790
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the American Art Acquisition Fund, 2009.99

Human Generated Data

Title

Col. Dudley Colman (1745-1797)

People

Artist: Unidentified Artist,

Date

c. 1790

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-04

Pendant 98.8
Person 94.3
Human 94.3
Painting 72.7
Art 72.7
Jewelry 67.8
Accessories 67.8
Accessory 67.8
Locket 67.8

Clarifai
created on 2018-03-23

art 97.9
one 97.8
people 96.7
portrait 95.6
woman 94.7
illustration 92.7
antique 91.7
adult 91.6
no person 90.8
jewelry 90.3
decoration 90.1
gold 89.6
veil 88.7
painting 88.7
wear 88.3
symbol 86.7
ancient 85.8
retro 85.3
old 84.6
oval 84.3

Imagga
created on 2018-03-23

sombrero 100
hat 91.8
headdress 63.6
clothing 41.8
money 30.6
currency 30.5
covering 23.2
finance 22.8
cash 22
consumer goods 21.2
dollar 20.4
financial 17.8
business 17.6
banking 17.5
one 17.2
bank 17
mosaic 16.9
art 16.1
old 15.3
wealth 15.3
pay 14.4
portrait 13.6
bill 13.3
closeup 12.8
paper 12.5
person 12.5
vintage 11.6
symbol 11.4
face 11.4
metal 11.3
close 10.8
religion 10.7
banknote 10.7
coin 10.5
rich 10.2
economy 10.2
gold 9.9
hundred 9.7
us 9.6
payment 9.6
black 9.6
icon 9.5
church 9.2
object 8.8
ancient 8.6
exchange 8.6
commerce 8.4
investment 8.2
man 8.1
museum 7.9
shiny 7.9
golden 7.7
dollars 7.7
change 7.7
god 7.6
percussion instrument 7.4
shield 7.3
gong 7.3
lady 7.3
success 7.2

Google
created on 2018-03-23

jewellery 88.2
fashion accessory 83.3
locket 83.2
picture frame 61.1
pendant 59.6
oval 56.1

Microsoft
created on 2018-03-23

indoor 88.5
accessory 35.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 98%
Disgusted 8.1%
Happy 6.7%
Calm 10.2%
Angry 10.3%
Surprised 28.4%
Confused 19.2%
Sad 17.1%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.3%
Painting 72.7%
Locket 67.8%

Captions

Microsoft

a person looking at the camera 53.4%
a person standing in front of a mirror posing for the camera 30.5%
the face of a person 30.4%