Human Generated Data

Title

Thomas Carlyle (1795-1881)
Date

1865
People

Artist: Studio of Elliott & Fry, British active 1863-1880s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.308

Human Generated Data

Title

Thomas Carlyle (1795-1881)

People

Artist: Studio of Elliott & Fry, British active 1863-1880s

Date

1865

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.308

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Art 97.9
Drawing 96.7
Human 96.7
Sketch 85
Person 84.8
Painting 78.6
Face 55.2

Clarifai
created on 2023-10-25

people 99.6
portrait 99.5
art 99.4
adult 99.4
wear 99
man 98.9
one 98.2
woman 97.6
veil 97.6
two 97.5
retro 96.5
illustration 96.2
sepia 94.7
sepia pigment 93.7
painting 93.1
old 92.4
print 89.8
facial hair 88.4
vintage 87.5
paper 86.1

Imagga
created on 2022-01-08

currency 38.6
money 37.4
toilet seat 37.3
cash 35.7
dollar 31.6
finance 29.6
china 29.2
seat 29.2
bank 25.1
financial 24.1
paper 23.9
dollars 22.2
furniture 21.7
porcelain 21.2
wealth 20.7
ceramic ware 20.2
business 20
banknote 19.4
banking 19.3
bill 19
pay 17.3
exchange 16.2
finances 15.4
close 15.4
furnishing 15
us 14.5
utensil 14.2
savings 14
hundred 13.6
banknotes 12.7
one 12.7
pick 12.7
economy 12.1
note 11.9
device 11.6
payment 11.5
closeup 11.5
rich 11.2
texture 11.1
art 11.1
symbol 10.8
bills 10.7
coins 10.6
notes 10.5
sketch 10.4
drawing 10
concepts 9.8
plate 9.8
old 9.8
food 9.6
coin 9.5
stucco 9.4
grunge 9.4
funds 8.8
value 8.7
loan 8.6
sign 8.3
investment 8.2
yellow 7.9
textured 7.9
economics 7.8
black 7.8
color 7.8
buy 7.5
commerce 7.5
globe 7.4
earth 7.3
detail 7.2

Google
created on 2022-01-08

Hair 98.3
Jaw 87.8
Art 82.1
Font 76.2
Suit 72.6
Tints and shades 72
Vintage clothing 71.9
Beard 69.2
Visual arts 66.9
Paper 66.4
Moustache 66.2
Paper product 65.1
Illustration 64.4
Circle 64.1
Facial hair 62.5
Self-portrait 62.2
Room 62.1
History 61.9
Portrait 54.7
Retro style 54.5

Microsoft
created on 2022-01-08

text 99.6
human face 97.7
drawing 97.1
sketch 95.6
man 88.9
person 83.6
portrait 66.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 99.7%
Calm 85.2%
Sad 6.8%
Confused 5.2%
Disgusted 0.8%
Happy 0.6%
Fear 0.5%
Surprised 0.5%
Angry 0.4%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 84.8%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2022-01-08

a close up of a book 34.7%
close up of a book 31.2%
a close up of a book cover 31.1%

Text analysis

Amazon

Photo
Portman
S
J.
55,Balter S Portman Sq.W.
Sq.W.
Elliotz
Elliotz &Fry Photo
55,Balter
&Fry
J. (artyle(1865)
(artyle(1865)

Google

7. Carl(1$63) 55,Balter S Fortman Sq W. Elliott & Fry. Photo
7.
Carl(1$63)
55,Balter
S
Fortman
Sq
W.
&
Fry.
Photo
Elliott