Human Generated Data

Title

Henry Brooks Adams, Quincy (1838-1918)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2052

Human Generated Data

Title

Henry Brooks Adams, Quincy (1838-1918)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Person 99.3
Human 99.3
Face 90.1
Art 81.3
Text 75
Apparel 73.1
Clothing 73.1
Photo 69.2
Portrait 69.2
Photography 69.2
Head 58.7
Overcoat 56.9
Coat 56.9
Drawing 55.6
Painting 55.3

Clarifai
created on 2018-03-23

people 99
one 97
adult 92.9
wear 90.6
portrait 90.1
leader 87.9
man 87.1
retro 85.7
no person 84.6
religion 84.3
text 81.4
art 80.4
child 76.6
woman 76.3
vintage 74.8
two 73.3
music 72.5
facial expression 69.7
veil 69.7
group 69.3

Imagga
created on 2018-03-23

pick 100
device 88.7
diagram 34.1
drawing 27.6
money 22.1
representation 19.6
currency 18.8
finance 16
circle 15.9
cash 15.5
coin 15.2
symbol 14.8
puck 14
old 13.9
disk 13.9
black 13.8
sign 12.8
coins 12.5
grunge 11.9
bank 11.6
pattern 11.6
dollar 11.1
texture 11.1
wealth 10.8
vintage 10.7
financial 10.7
close 10.3
object 10.3
rich 10.2
banking 10.1
retro 9.8
one 9.7
metal 9.6
design 9.6
antique 9.5
paper 9.4
business 9.1
silver 8.8
art 8.5
economy 8.3
aged 8.1
dirty 8.1
painting 8.1
closeup 8.1
water 8
sand 8
icon 7.9
exchange 7.6
love 7.1
world 7.1
day 7.1
phonograph record 7

Google
created on 2018-03-23

circle 59.3
art 59.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.8%
Angry 4.8%
Happy 0.3%
Surprised 2.2%
Sad 10.1%
Calm 68%
Confused 11.1%
Disgusted 3.5%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

an old photo of Henry Adams 50.2%
a black and white photo of Henry Adams 41.3%
an old photo of a bird 19.2%

Text analysis

Amazon

Hemy
16.
Adams.
Hemy ds.. Adams.
Duiney
CTremry 16. 1808: Duiney
1808:
ds..
CTremry

Google

clams Ruine 6. 188
Ruine
6.
188
clams