Human Generated Data

Title

Scrapbook
Date

1864-1890
People

Artist: F. Mallhay, British? 19th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.366

Human Generated Data

Title

Scrapbook

People

Artist: F. Mallhay, British? 19th century

Date

1864-1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.366

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Person 98.7
Human 98.7
Military Uniform 96.4
Officer 96.4
Military 96.4
Soldier 70.8
Captain 64
Art 57.6

Clarifai
created on 2019-11-11

people 98.8
art 96.9
portrait 96.6
one 96.5
painting 96.4
adult 95
wear 89.4
leader 89.1
man 86.5
illustration 85.9
woman 82.1
museum 81.5
famous 73.7
furniture 73.6
picture frame 73.6
profile 73.3
no person 73
print 72.6
two 70.7
retro 67.3

Imagga
created on 2019-11-11

vintage 28.9
old 27.9
antique 24.2
art 23
binding 21.8
book jacket 21.2
paper 18.8
ancient 18.2
jacket 17.5
sculpture 17.1
grunge 17
covering 16.9
envelope 16.7
retro 16.4
stamp 15.6
culture 15.4
texture 15.3
postage 14.7
mail 14.4
religion 14.3
history 14.3
post 14.3
symbol 13.5
currency 13.5
design 13.1
letter 12.8
postmark 12.8
postal 12.8
wrapping 12.5
wall 12.1
money 11.9
cash 11.9
carving 11.5
bill 11.4
frame 11.3
detail 11.3
finance 11
aged 10.9
black 10.8
statue 10.7
one 10.4
temple 10.4
protective covering 10.3
religious 10.3
binder 10.3
dollar 10.2
banking 10.1
global 10
bank 10
device 9.7
museum 9.7
pattern 9.6
painted 9.5
icon 9.5
architecture 9.4
ornate 9.1
door 9
stamps 8.9
printed 8.9
paintings 8.8
delivery 8.7
fine 8.6
blank 8.6
close 8.6
travel 8.4
church 8.3
painter 8.2
office 8.2
collection 8.1
wealth 8.1
container 8
drawing 7.9
post mail 7.9
zigzag 7.9
masterpiece 7.9
fame 7.9
business 7.9
known 7.9
shows 7.9
renaissance 7.9
empty 7.7
cutting 7.7
communications 7.7
worn 7.6
rusty 7.6
unique 7.6
historical 7.5
sign 7.5
blackboard 7.5
savings 7.5
gold 7.4
historic 7.3
artwork 7.3
decoration 7.3
paint 7.2
face 7.1
book 7
locker 7

Google
created on 2019-11-11

Photograph 95.8
Picture frame 84.4
Illustration 70.1
Art 69.5
Room 65.7
Vintage clothing 58
Antique 54.2
Drawing 53.7

Microsoft
created on 2019-11-11

clothing 98.9
person 98.9
gallery 97.9
human face 97.4
room 97.3
man 97.2
scene 96.9
indoor 88
picture frame 87.4
text 73
white 64.3
old 57.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 44-62
Gender Male, 93.2%
Surprised 0.4%
Confused 3.6%
Sad 1.2%
Happy 0.4%
Disgusted 0.9%
Fear 0.2%
Calm 15.2%
Angry 78.2%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Categories

Imagga

paintings art 99.1%

Captions

Microsoft
created on 2019-11-11

an old photo of a person 45.3%
old photo of a person 41.3%
an old photo of a room 41.2%

Text analysis

Amazon

1888.
Cous
Rev: ch, Cous
Rev:
ch,

Google

Rev.Ch.CoruH 1888.
Rev.Ch.CoruH
1888.