Human Generated Data

Title

George Howard, Ninth Earl of Carlisle
Date

c. 1864-1865
People

Artist: Julia Margaret Cameron, British 1815 - 1879
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan in honor of Jakob Rosenberg, 40.1979

Human Generated Data

Title

George Howard, Ninth Earl of Carlisle

People

Artist: Julia Margaret Cameron, British 1815 - 1879

Date

c. 1864-1865

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 97.2
Human 97.2
Art 89
Advertisement 76.9
Poster 74.6
Face 72.3
Painting 70.6
Wood 65.1
Portrait 63.4
Photography 63.4
Photo 63.4
Text 62.1
Finger 60
Collage 57.7
Apparel 55.3
Clothing 55.3

Imagga
created on 2022-01-23

grandma 100
senior 32.8
people 28.5
portrait 27.2
child 26.7
mature 26
adult 25.9
person 24.8
happy 24.4
old 24.4
man 24.2
elderly 23.9
home 23.9
male 22.2
smiling 21
retired 20.4
couple 19.2
mother 19
retirement 18.3
hair 18.2
sitting 18
family 16.9
love 16.6
happiness 16.5
looking 15.2
human 15
together 14.9
lady 14.6
lifestyle 14.5
face 14.2
parent 13.4
smile 12.8
grandfather 12.5
head 11.8
grandmother 11.7
aged 10.9
cute 10.8
holding 10.7
older 10.7
hand 10.6
husband 10.5
one 10.5
house 10
kid 9.7
boy 9.6
wife 9.5
eyes 9.5
life 9.4
two 9.3
health 9
gray 9
fun 9
blond 8.9
indoors 8.8
women 8.7
affection 8.7
sofa 8.6
loving 8.6
age 8.6
relaxed 8.5
relaxation 8.4
pensioner 8.3
care 8.2
little 8
60s 7.8
lounge 7.8
sadness 7.8
affectionate 7.7
modern 7.7
relationship 7.5
room 7.3
laptop 7.3
computer 7.2
romantic 7.1
look 7
model 7

Google
created on 2022-01-23

Collar 79
Sleeve 76.5
Tints and shades 76.5
Vintage clothing 72.5
Plant 71.3
Art 70
Visual arts 66.2
Suit 63.6
Blazer 63.5
History 62.8
Room 62.5
Sitting 56.5
Portrait 56.3
Self-portrait 56.2
Paper product 53.1
Trench coat 52.4
Smile 50.7
Retro style 50.5

Microsoft
created on 2022-01-23

clothing 99
human face 96.8
person 96.5
gallery 96.1
text 91.9
room 90.2
old 84.6
man 82.5
photograph 79.1
scene 74.4
portrait 52.9
vintage 27.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 99.6%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%
Painting 70.6%

Captions

Microsoft

a vintage photo of a man holding a teddy bear 39%
a vintage photo of a teddy bear 38.9%
a vintage photo of a man with a teddy bear 38.8%

Text analysis

Amazon

2
of
The
Job
copy
Bla
M.B.
part deased THE tegri component 2 The acquisity of Howare's copy of Bla kee Baok of Job M.B. own
component
Baok
own
kee
THE
Howare's
tegri
deased
Lulie
Lulie Muis
Muis
part
acquisity