Human Generated Data

Title

Henry Jacob Bigelow (1818-1890) (standing)
Date

c. 1854
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Massachusetts General Hospital Archives and Special Collections, 5.1979

Human Generated Data

Title

Henry Jacob Bigelow (1818-1890) (standing)

People

Artist: Unidentified Artist,

Date

c. 1854

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Human 99.2
Person 99.2
Art 85
Clothing 74.1
Apparel 74.1
Painting 73.8
Text 69.2

Clarifai
created on 2018-04-18

people 99.9
one 99.3
adult 99
art 98.9
portrait 98.9
painting 98.5
print 97.4
man 96.2
wear 96.2
music 95.9
illustration 93.3
side view 92.9
veil 92.7
religion 89.5
facial hair 88.3
leader 87.6
profile 85.9
drum 85.6
old 83.1
lid 81.5

Imagga
created on 2018-04-18

shield 100
armor 100
protective covering 95.5
covering 64
money 34.9
currency 34.1
finance 29.6
cash 29.3
financial 24.9
coin 23.8
bank 23.3
old 23
wealth 22.4
dollar 21.4
banking 21.1
coins 20.3
business 18.8
economy 16.7
paper 16.5
pay 16.3
exchange 16.2
symbol 16.2
one 14.9
vintage 14.9
close 14.8
retro 14.7
metal 14.5
us 14.5
sign 13.5
savings 13
stamp 12.6
change 12.5
investment 11.9
dollars 11.6
icon 11.1
grunge 11.1
object 11
black 10.8
value 10.7
world 10.6
bill 10.5
art 10
gold 9.9
finances 9.6
mail 9.6
england 9.5
antique 9.5
closeup 9.4
rich 9.3
texture 9
states 8.7
payment 8.7
price 8.6
united 8.6
buy 8.5
global 8.2
aged 8.1
silver 8
postmark 7.9
cent 7.9
president 7.9
ancient 7.8
commerce 7.5
map 7.5
design 7.3
toilet seat 7.3
detail 7.2
dirty 7.2

Google
created on 2018-04-18

photograph 94.8
picture frame 72.6
history 66.5
stock photography 54.5
painting 52.4
art 51.9

Microsoft
created on 2018-04-18

black 68.6
old 56.7
plaque 16.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Male, 96.6%
Happy 1%
Disgusted 4.3%
Confused 7.9%
Angry 18.1%
Calm 58.2%
Sad 8%
Surprised 2.5%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 73.8%

Captions

Microsoft

an old photo of a person 74.5%
old photo of a person 71.5%
a black and white photo of a person 60.9%