Human Generated Data

Title

A Tejon Serrano
Date

1924
People

Artist: Edward Sheriff Curtis, American 1868 - 1952
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.12

Human Generated Data

Title

A Tejon Serrano

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Date

1924

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Face 99.9
Human 99.9
Head 96.9
Person 93.4
Photography 84.1
Portrait 84.1
Photo 84.1
Man 62.2
Art 61
Wood 60.4

Imagga
created on 2022-01-09

portrait 40.8
man 38.4
grandma 37.1
face 30.6
male 30
person 27.7
adult 25.3
grandfather 25
people 24
old 23
senior 20.7
hair 20.6
statue 19.8
mature 19.6
one 19.4
close 18.3
serious 18.1
expression 17.9
beard 17.8
head 16
human 15.8
elderly 15.3
looking 15.2
men 14.6
sculpture 14.6
handsome 14.3
black 13.8
eyes 13.8
retired 13.6
guy 12.8
world 12.4
money 11.9
happy 11.9
currency 11.7
casual 11
model 10.9
retirement 10.6
age 10.5
boy 10.5
closeup 10.1
mug shot 10.1
cash 10.1
smile 10
aged 10
gray 9.9
sad 9.7
aging 9.6
nose 9.6
bill 9.5
thinking 9.5
dollar 9.3
look 8.8
depression 8.8
smiling 8.7
lifestyle 8.7
art 8.5
pensioner 8.5
bow tie 8.4
representation 8.4
emotion 8.3
skin 8.2
mother 8.1
photograph 7.8
spectacles 7.8
thoughtful 7.8
necktie 7.7
attractive 7.7
culture 7.7
hand 7.6
life 7.6
shirt 7.6
dark 7.5
bust 7.4
banking 7.4
bank 7.2
eye 7.2

Google
created on 2022-01-09

Forehead 98.5
Nose 98.4
Chin 96.7
Eyebrow 94.4
Jaw 88.3
Art 82.6
Wrinkle 79.7
Vintage clothing 74
Self-portrait 72.5
Painting 71.5
Visual arts 67
No expression 66.4
Illustration 65.7
History 65.3
Stock photography 64.9
Paper product 62.2
Paper 61.2
Portrait 59.6
Portrait photography 58.3
Physicist 57.7

Microsoft
created on 2022-01-09

person 99.1
text 97.7
human face 97.4
man 97.3
book 95.3
portrait 87.5
wrinkle 51
staring 17.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 99.5%
Sad 67.6%
Calm 25.9%
Disgusted 2.8%
Confused 1.6%
Fear 1%
Angry 0.5%
Surprised 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.4%

Captions

Microsoft

a man holding a book 34.4%
a man looking at a book 34.3%
a man looking at the camera 34.2%

Text analysis

Amazon

513
TEJON
BERRANO
Plato 513
Plato
A TEJON BERRANO
A
anything
Boy
Son anything
IS
the
the Boy IS Best
Son
Best

Google

Plato
A
TEJON
Plato 513 A TEJON BERRANO
513
BERRANO