Human Generated Data

Title

Mrs. Harleston Parker (née A. Ellen Reynolds)
Date

1893
People

Artist: Pach Brothers, American 1867-1947
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, On loan from Special Collections, Fine Arts Library, Harvard College Library, 119.1976.475

Human Generated Data

Title

Mrs. Harleston Parker (née A. Ellen Reynolds)

People

Artist: Pach Brothers, American 1867-1947

Date

1893

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, On loan from Special Collections, Fine Arts Library, Harvard College Library, 119.1976.475

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Human 99.3
Person 99.3
Person 98.9
Art 94.3
Painting 80.9
Drawing 73
Sketch 56.6

Clarifai
created on 2021-04-03

people 99.1
portrait 98.5
art 97.3
vintage 95.7
painting 95.5
man 95.3
wear 94.7
adult 94.7
book bindings 93.2
old 93.1
two 92.1
one 91.9
picture frame 91.6
antique 91.2
woman 91.1
retro 90.3
group 87.3
museum 85.8
margin 84.5
no person 84.4

Imagga
created on 2021-04-03

carving 35.9
sculpture 33.3
currency 30.5
money 29.8
paper 28.3
art 28.3
dollar 26
vintage 25.9
cash 23.8
bill 22.8
finance 22.8
theater curtain 22.2
old 21.6
plastic art 20
financial 19.6
bank 18.8
gold 18.1
curtain 17.6
antique 17.6
dollars 17.4
retro 17.2
business 17
frame 17
covering 16.8
one 16.4
museum 16.2
book jacket 15.6
hundred 15.5
close 15.4
wealth 15.3
culture 14.5
protective covering 13.9
ancient 13.8
banking 13.8
banknote 13.6
blind 13.3
savings 13
grunge 12.8
us 12.5
history 12.5
texture 12.5
device 12.4
jacket 12.2
book 12.1
closeup 12.1
black 12
note 11.9
design 11.9
border 10.8
post 10.5
detail 10.5
office 10.4
portrait 10.3
golden 10.3
rich 10.2
classic 10.2
symbol 10.1
investment 10.1
face 9.9
paintings 9.8
finances 9.6
pay 9.6
pattern 9.6
exchange 9.5
blank 9.4
wrapping 9.2
letter 9.2
renaissance 8.8
stamp 8.7
loan 8.6
profit 8.6
binding 8.6
fine 8.6
elegance 8.4
envelope 8.2
ornate 8.2
brown 8.1
icon 7.9
masterpiece 7.9
known 7.9
postmark 7.9
franklin 7.9
postage 7.9
postal 7.8
decoration 7.8
banknotes 7.8
mail 7.7
god 7.6
unique 7.6
economy 7.4
historic 7.3
global 7.3
card 7.3
concepts 7.1

Google
created on 2021-04-03

Head 97.2
Product 90.7
Sleeve 87.2
Rectangle 83.2
Art 75.1
Electronic device 74.1
Wood 73.5
Metal 69.1
History 61.4
Serveware 59
Visual arts 58.5
Magenta 57.7
Vintage clothing 57.1
Computer accessory 54.9
Portrait 51.9
Antique 51.3
Facial hair 50.6
Collection 50.4
Square 50.4

Microsoft
created on 2021-04-03

human face 96.6
indoor 94.3
person 93.4
clothing 80.7
text 70.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 55-73
Gender Female, 76.7%
Calm 96.2%
Happy 2.3%
Confused 0.5%
Sad 0.4%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 57-75
Gender Female, 69.8%
Calm 95.7%
Happy 2.6%
Sad 0.5%
Angry 0.4%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

paintings art 99.4%

Captions

Microsoft
created on 2021-04-03

an old photo of a train 52.2%
old photo of a train 46.2%
an old photo of a bus 31.9%