Human Generated Data

Title

S.R. Spaulding
Date

19th century
People

Artist: Joseph Andrews, American 1806 - 1873
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Joseph Andrews, G4218

Human Generated Data

Title

S.R. Spaulding

People

Artist: Joseph Andrews, American 1806 - 1873

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Joseph Andrews, G4218

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Human 99
Person 99
Art 98.3
Face 89.4
Art Gallery 86.6
Drawing 85.9
Wood 76.5
Painting 74.5
Sketch 68.9
Photo 68.2
Photography 68.2
Portrait 63.8
Head 59.7
Floor 59.6

Clarifai
created on 2019-10-30

people 98.8
portrait 97.1
adult 96.6
one 94.6
wear 92.3
art 91.9
woman 91.5
room 89.6
facial expression 88.2
man 86.6
retro 86.3
girl 85.4
music 82.6
indoors 82.6
furniture 82.2
fashion 81.8
window 79.8
picture frame 79.3
light 78.8
vintage 78.1

Imagga
created on 2019-10-30

mug shot 27.6
envelope 23.8
representation 23.3
photograph 23.1
stamp 22.9
paper 20.8
old 19.5
portrait 18.1
currency 17.9
design 17.8
vintage 17.4
money 16.2
symbol 14.8
creation 14.3
bill 14.3
art 14
face 13.5
drawing 13.1
container 12.4
retro 12.3
antique 12.1
cash 11.9
bank 11.8
sketch 11.7
die 11.6
people 11.2
head 10.9
black 10.9
business 10.3
person 10.3
banking 10.1
card 9.9
banknote 9.7
close 9.7
brown 9.6
grunge 9.4
note 9.2
texture 9
sign 9
queen 8.8
man 8.7
shaping tool 8.7
mail 8.6
post 8.6
one 8.2
binding 8.2
object 8.1
financial 8
hair 7.9
textured 7.9
postage 7.9
model 7.8
eyes 7.7
blank 7.7
worn 7.6
finance 7.6
happy 7.5
frame 7.5
dollar 7.4
economy 7.4
letter 7.3
aged 7.2
office 7.2
color 7.2
collection 7.2
wealth 7.2
celebration 7.2
adult 7.1
wall 7
look 7

Google
created on 2019-10-30

Photograph 95.5
Moustache 79.2
Art 78.1
Portrait 68.6
Drawing 66.9
Illustration 66.9
Room 65.7
Picture frame 64.5
Facial hair 60.7
Visual arts 55

Microsoft
created on 2019-10-30

human face 97.6
man 95.6
wall 95.4
person 93.7
indoor 88.4
clothing 87
drawing 73.3
gallery 64.4
room 63.8
white 61.2
text 59.6
picture frame 54.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-61
Gender Male, 97.8%
Happy 0.2%
Confused 0.1%
Disgusted 0%
Sad 0.2%
Angry 0.5%
Fear 0%
Calm 98.9%
Surprised 0.1%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Categories

Imagga

paintings art 98.7%

Captions

Microsoft
created on 2019-10-30

a close up of a box 59.4%
a close up of a white wall 59.3%
an old photo of a person 47.9%