Human Generated Data

Title

Untitled (a poet)
Date

c. 1892-c. 1905
People

Artist: Sarah Choate Sears, American 1858 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Montgomery S. Bradley and Cameron Bradley, P1984.72

Human Generated Data

Title

Untitled (a poet)

People

Artist: Sarah Choate Sears, American 1858 - 1935

Date

c. 1892-c. 1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 95.6
Person 95.6
Sitting 84.1
Apparel 69.8
Clothing 69.8
Finger 60.9
Text 60.5
Reading 58.7
Coat 57.2
Overcoat 57.2
Photo 56.3
Photography 56.3
Face 56.3
Portrait 56.3

Imagga
created on 2022-01-23

person 30.9
man 26.3
portrait 25.9
people 21.8
adult 21.4
male 19.2
comedian 18.7
black 18.2
face 17.8
performer 16.8
old 16
hair 15.9
human 15
expression 14.5
call 13.5
love 13.4
dark 13.4
senior 12.2
eyes 12.1
entertainer 11.9
vintage 11.6
pretty 11.2
painter 11.1
model 10.9
world 10.9
happy 10.7
look 10.5
attractive 10.5
serious 10.5
groom 10.4
religion 9.9
looking 9.6
body 9.6
couple 9.6
head 9.2
grandma 9.2
alone 9.1
book jacket 9.1
fashion 9.1
jacket 9
suit 9
one 9
sexy 8.8
skin 8.7
light 8.7
hands 8.7
sad 8.7
art 8.7
god 8.6
mother 8.6
smile 8.6
hand 8.5
life 8
night 8
antique 7.8
prayer 7.7
hope 7.7
religious 7.5
glasses 7.4
church 7.4
lady 7.3
businessman 7.1
statue 7

Google
created on 2022-01-23

Black 89.6
Art 78.8
Suit 78
Blazer 77
Microphone 76.7
Snapshot 74.3
Monochrome photography 69.6
Event 68.3
Monochrome 67
Vintage clothing 66.1
Stock photography 65.7
Visual arts 64.7
Artist 64
History 62.6
Sitting 62.4
Self-portrait 58.5
Portrait 57.3
White-collar worker 56.4
Music 55.3
Wrinkle 55.1

Microsoft
created on 2022-01-23

text 98.5
human face 94.9
person 94.3
man 91.7
clothing 90.5
indoor 85.6
black and white 71

Face analysis

Amazon

Google

AWS Rekognition

Age 59-67
Gender Male, 78.4%
Sad 98.2%
Confused 1%
Calm 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.6%

Captions

Microsoft

a man sitting on a table 80.3%
a man sitting at a table 80.2%
a man wearing a suit and tie 80.1%