Human Generated Data

Title

Untitled (stonemason with the tools of his trade)
Date

c. 1850-1860
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.9

Human Generated Data

Title

Untitled (stonemason with the tools of his trade)

People

Artist: Unidentified Artist,

Date

c. 1850-1860

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.9

Machine Generated Data

Tags

Amazon
created on 2019-07-19

Person 99.7
Human 99.7
Art 92.9
Painting 92.9
Text 57.5

Clarifai
created on 2019-07-19

people 96.5
painting 96.2
art 95.8
no person 95.8
retro 91.9
one 91.3
antique 90.7
wear 87.7
picture frame 87.5
illustration 85.5
ancient 85.1
old 85
decoration 83.7
vintage 83.1
museum 82.2
print 81.8
man 81.1
adult 81
wood 77
symbol 76

Imagga
created on 2019-07-19

wallet 48.3
binder 47.7
binding 47.7
protective covering 40.2
covering 34.8
container 34.4
old 32.8
paper 31.4
case 31.3
vintage 30.6
frame 28.3
texture 25.7
grunge 23
retro 22.9
finance 21.1
business 20.7
blank 20.6
antique 19.9
money 19.6
black 18.6
chalkboard 18.6
art 18.3
empty 18
leather 17.2
notebook 16.7
border 16.3
brown 16.2
symbol 15.5
wall 15.4
aged 15.4
board 15.4
book 15.3
purse 15.1
blackboard 14.9
education 14.7
ancient 14.7
note 14.7
cash 14.6
currency 14.4
decoration 13.8
object 13.2
gold 13.2
pattern 13
school 12.6
dollar 12.1
page 12.1
letter 11.9
design 11.8
chalk 11.7
financial 11.6
book jacket 11.6
savings 11.2
nobody 10.9
wealth 10.8
information 10.6
wooden 10.5
success 10.5
close 10.3
study 10.3
document 10.2
banking 10.1
closeup 10.1
wood 10
text 9.6
worn 9.5
icon 9.5
golden 9.5
bag 9.1
sign 9
jacket 9
history 8.9
textured 8.8
banknote 8.7
writing 8.5
decorative 8.4
cover 8.3
message 8.2
idea 8
museum 7.8
parchment 7.7
pay 7.7
concrete 7.7
wallpaper 7.7
card 7.7
post 7.6
tray 7.6
bill 7.6
learn 7.6
shopping 7.3
ornate 7.3
metal 7.2
office 7.2
religion 7.2

Google
created on 2019-07-19

Picture frame 83.3
Art 50.2

Microsoft
created on 2019-07-19

wall 97.2
book 93.8
indoor 92.2
clothing 70.3
person 67.5
old 45.1
case 37.1
picture frame 22.6
painting 16.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Male, 77.9%
Confused 2.4%
Angry 50.2%
Disgusted 2.5%
Surprised 2.2%
Sad 33.7%
Calm 7.5%
Happy 1.4%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 92.9%

Captions

Microsoft
created on 2019-07-19

an old photo of a person 53.2%

Text analysis

Amazon

APEO
:e3:r
d:
c: APCOAtar
Sellwe