Human Generated Data

Title

A Pyramid Lake Paviotso

Date

1924

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.31

Human Generated Data

Title

A Pyramid Lake Paviotso

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Date

1924

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.8
Face 99.8
Head 97.2
Photo 77.8
Portrait 77.8
Photography 77.8
Art 63.3
Person 60.4

Imagga
created on 2022-01-09

grandfather 52.4
man 38.4
portrait 36.9
person 35.1
senior 32.8
old 30.7
face 30.6
male 29.2
mature 26.1
one 25.4
people 24
adult 22.7
elderly 22
grandma 21.6
close 21.1
head 21
fan 20.1
statue 20
human 19.5
hair 19
looking 17.6
eyes 17.2
serious 17.2
expression 17.1
beard 16.5
follower 16.2
age 16.2
retired 15.5
gray 14.4
aged 13.6
retirement 13.5
men 12.9
depression 12.7
sad 12.6
sculpture 12.2
money 11.9
happy 11.9
grandmother 11.8
eye 11.6
dollar 11.2
glasses 11.1
cash 11
skin 10.9
currency 10.8
pensioner 10.7
aging 10.6
black 10.2
wrinkle 9.8
wisdom 9.7
older 9.7
look 9.6
bill 9.5
casual 9.3
life 9.2
banking 9.2
bank 9
elder 8.9
success 8.9
despair 8.8
wrinkled 8.8
sadness 8.8
us 8.7
thinking 8.6
finance 8.5
hand 8.4
emotion 8.3
handsome 8
wrinkles 7.9
depressed 7.9
worried 7.9
culture 7.7
pain 7.7
nose 7.6
ruler 7.6
alone 7.3
business 7.3
smiling 7.2
lifestyle 7.2
smile 7.1
model 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 99.1
human face 97.2
person 90.2
man 87.9
indoor 87.7
old 80
portrait 79.4
painting 78.9
drawing 77.9
sketch 77
staring 20.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Sad 98.2%
Angry 0.5%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%
Calm 0.1%
Surprised 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 60.4%

Captions

Microsoft

an old photo of a person 79%
old photo of a person 74.6%
an old photo of a person with a beard 56.5%

Text analysis

Amazon

LAKE
A
535
A PYRAMID LAKE PAVIOTSO
PYRAMID
Plate 535
Plate
PAVIOTSO
Sugar
35 Sugar one
one
35

Google

PAVIOT80
535
A
Plate 535 A PYRAMID LAKE PAVIOT80
Plate
PYRAMID
LAKE