Human Generated Data

Title

A Pyramid Lake Paviotso
Date

1924
People

Artist: Edward Sheriff Curtis, American 1868 - 1952
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.124.31

Human Generated Data

Title

A Pyramid Lake Paviotso

People

Artist: Edward Sheriff Curtis, American 1868 - 1952

Date

1924

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.8
Face 99.8
Head 97.2
Photo 77.8
Portrait 77.8
Photography 77.8
Art 63.3
Person 60.4

Imagga
created on 2022-01-09

grandfather 52.4
man 38.4
portrait 36.9
person 35.1
senior 32.8
old 30.7
face 30.6
male 29.2
mature 26.1
one 25.4
people 24
adult 22.7
elderly 22
grandma 21.6
close 21.1
head 21
fan 20.1
statue 20
human 19.5
hair 19
looking 17.6
eyes 17.2
serious 17.2
expression 17.1
beard 16.5
follower 16.2
age 16.2
retired 15.5
gray 14.4
aged 13.6
retirement 13.5
men 12.9
depression 12.7
sad 12.6
sculpture 12.2
money 11.9
happy 11.9
grandmother 11.8
eye 11.6
dollar 11.2
glasses 11.1
cash 11
skin 10.9
currency 10.8
pensioner 10.7
aging 10.6
black 10.2
wrinkle 9.8
wisdom 9.7
older 9.7
look 9.6
bill 9.5
casual 9.3
life 9.2
banking 9.2
bank 9
elder 8.9
success 8.9
despair 8.8
wrinkled 8.8
sadness 8.8
us 8.7
thinking 8.6
finance 8.5
hand 8.4
emotion 8.3
handsome 8
wrinkles 7.9
depressed 7.9
worried 7.9
culture 7.7
pain 7.7
nose 7.6
ruler 7.6
alone 7.3
business 7.3
smiling 7.2
lifestyle 7.2
smile 7.1
model 7

Google
created on 2022-01-09

Forehead 98.5
Chin 96.6
Eyebrow 93.9
Jaw 88.1
Art 83.7
Beard 79.4
Facial hair 75.9
Tints and shades 74.9
Moustache 74.8
Self-portrait 74.6
Visual arts 70.5
Painting 68.6
Vintage clothing 68.3
Illustration 66.4
Wrinkle 66.2
History 65.8
Stock photography 63.2
Drawing 59.8
Portrait 59.2
Paper product 54.3

Microsoft
created on 2022-01-09

text 99.1
human face 97.2
person 90.2
man 87.9
indoor 87.7
old 80
portrait 79.4
painting 78.9
drawing 77.9
sketch 77
staring 20.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Sad 98.2%
Angry 0.5%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%
Calm 0.1%
Surprised 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 60.4%

Captions

Microsoft

an old photo of a person 79%
old photo of a person 74.6%
an old photo of a person with a beard 56.5%

Text analysis

Amazon

LAKE
A
535
A PYRAMID LAKE PAVIOTSO
PYRAMID
Plate 535
Plate
PAVIOTSO
Sugar
35 Sugar one
one
35

Google

PAVIOT80
535
A
Plate 535 A PYRAMID LAKE PAVIOT80
Plate
PYRAMID
LAKE