Human Generated Data

Title

A Southern Diegueño
Date

1924
People

Artist: Edward Sheriff Curtis, American 1868 - 1952
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.27

Human Generated Data

Title

A Southern Diegueño

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Date

1924

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Head 100
Face 99.8
Human 99.8
Art 92.3
Person 86.7
Photography 85.1
Photo 85.1
Portrait 85.1
Painting 76.1
Sculpture 56.4

Imagga
created on 2022-01-09

man 46.4
male 44.4
bow tie 43.4
spectacles 40
face 38.4
portrait 36.9
necktie 35.5
person 32.7
optical instrument 29.5
handsome 28.6
adult 27.2
serious 24.8
attractive 23.1
guy 22.5
looking 22.4
people 20.7
hair 20.6
beard 20.3
model 20.2
expression 19.6
instrument 18.6
head 18.5
casual 17.8
garment 17.8
black 17.5
eyes 17.2
closeup 16.2
one 15.7
close 15.4
human 15
boy 14.8
child 14.6
clothing 14
happy 13.8
confident 13.7
skin 13.3
look 13.2
juvenile 12.8
youth 12.8
smile 12.1
men 12
smiling 11.6
sexy 11.3
lifestyle 10.9
stare 10.7
fashion 10.6
muscular 10.5
thinking 10.5
device 10.4
body 10.4
adolescent 9.9
thoughtful 9.7
shirt 9.3
dark 9.2
health 9
hand 8.4
lips 8.3
alone 8.2
healthy 8.2
cute 7.9
love 7.9
masculine 7.8
sad 7.7
good 7.5
style 7.4
emotion 7.4
against 7.4
macho 7.3
business 7.3
success 7.3
fitness 7.2
work 7.1

Google
created on 2022-01-09

Forehead 98.5
Sculpture 88.7
Jaw 88
Art 82.7
Collar 81.4
Statue 79.1
No expression 78.9
Facial hair 76.2
Tints and shades 75.5
Artifact 73.9
Vintage clothing 72.8
Moustache 71.2
Self-portrait 69.7
Visual arts 67.4
History 67
Wrinkle 63.8
Monochrome 61.1
Portrait photography 59.3
Portrait 56.4
Suit 53.7

Microsoft
created on 2022-01-09

human face 98.5
text 96
indoor 95.8
person 92.5
face 85.6
black 79.3
portrait 78.3
wearing 77.3
man 65.4
staring 25.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-50
Gender Male, 97.6%
Confused 41.2%
Sad 27.8%
Calm 17.7%
Disgusted 4.5%
Fear 2.7%
Happy 2.1%
Angry 2%
Surprised 1.9%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 86.7%

Captions

Microsoft

Caleb Cheeshahteaumuck wearing a suit and tie 92%
Caleb Cheeshahteaumuck looking at the camera 84.1%
Caleb Cheeshahteaumuck wearing a suit and tie looking at the camera 84%

Text analysis

Amazon

529
SOUTHERN
Plate 529
Plate
A
A SOUTHERN DISQUEÑO
DISQUEÑO
the
the de New
New
de

Google

Plate 5e9 K i de A BOUTHRN DINGUBtO
K
i
BOUTHRN
DINGUBtO
Plate
A
5e9
de