Human Generated Data

Title

A Tejon Serrano

Date

1924

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.12

Human Generated Data

Title

A Tejon Serrano

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Date

1924

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Face 99.9
Human 99.9
Head 96.9
Person 93.4
Photography 84.1
Portrait 84.1
Photo 84.1
Man 62.2
Art 61
Wood 60.4

Imagga
created on 2022-01-09

portrait 40.8
man 38.4
grandma 37.1
face 30.6
male 30
person 27.7
adult 25.3
grandfather 25
people 24
old 23
senior 20.7
hair 20.6
statue 19.8
mature 19.6
one 19.4
close 18.3
serious 18.1
expression 17.9
beard 17.8
head 16
human 15.8
elderly 15.3
looking 15.2
men 14.6
sculpture 14.6
handsome 14.3
black 13.8
eyes 13.8
retired 13.6
guy 12.8
world 12.4
money 11.9
happy 11.9
currency 11.7
casual 11
model 10.9
retirement 10.6
age 10.5
boy 10.5
closeup 10.1
mug shot 10.1
cash 10.1
smile 10
aged 10
gray 9.9
sad 9.7
aging 9.6
nose 9.6
bill 9.5
thinking 9.5
dollar 9.3
look 8.8
depression 8.8
smiling 8.7
lifestyle 8.7
art 8.5
pensioner 8.5
bow tie 8.4
representation 8.4
emotion 8.3
skin 8.2
mother 8.1
photograph 7.8
spectacles 7.8
thoughtful 7.8
necktie 7.7
attractive 7.7
culture 7.7
hand 7.6
life 7.6
shirt 7.6
dark 7.5
bust 7.4
banking 7.4
bank 7.2
eye 7.2

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.1
text 97.7
human face 97.4
man 97.3
book 95.3
portrait 87.5
wrinkle 51
staring 17.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Male, 99.5%
Sad 67.6%
Calm 25.9%
Disgusted 2.8%
Confused 1.6%
Fear 1%
Angry 0.5%
Surprised 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.4%

Captions

Microsoft

a man holding a book 34.4%
a man looking at a book 34.3%
a man looking at the camera 34.2%

Text analysis

Amazon

513
TEJON
BERRANO
Plato 513
Plato
A TEJON BERRANO
A
anything
Boy
Son anything
IS
the
the Boy IS Best
Son
Best

Google

Plato
A
TEJON
Plato 513 A TEJON BERRANO
513
BERRANO