Human Generated Data

Title

Joanne, 90, Long Island, NY

Date

2016

People

Artist: Jess T. Dugan, American born 1986

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Lisa Rich, 2019.192

Copyright

© Jess T. Dugan

Human Generated Data

Title

Joanne, 90, Long Island, NY

People

Artist: Jess T. Dugan, American born 1986

Date

2016

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Human 85.3
Head 78.7
Person 77.3
Art 75.2
Home Decor 71.1
Poster 70.8
Advertisement 70.8
Drawing 67
Collage 55.6

Clarifai
created on 2021-04-03

seat 99.6
room 99.5
furniture 99.5
chair 99.1
people 98.9
home 98.4
indoors 98.3
painting 98.3
easy chair 95.7
sofa 95.5
two 95.3
family 94.2
adult 94
woman 93.8
house 92.4
museum 91.9
interior design 90.7
sit 88.6
art 88.2
elderly 87.5

Imagga
created on 2021-04-03

musical instrument 43.9
accordion 37.2
teacher 34.7
keyboard instrument 34.3
chair 29.3
room 29
interior 27.4
educator 26.9
wind instrument 26.6
home 23.9
adult 22.4
person 20.3
people 19.5
professional 18.9
man 18.1
furniture 17.8
table 17.5
indoor 17.3
old 16.7
dancer 16
indoors 15.8
lifestyle 15.2
traditional 15
male 14.9
seat 14.9
luxury 14.6
portrait 12.9
sitting 12.9
fashion 12.8
decoration 12.3
design 11.8
house 11.7
vintage 11.6
lady 11.4
couple 11.3
attractive 11.2
performer 10.9
architecture 10.9
dress 10.8
holiday 10.7
couch 10.6
modern 10.5
style 10.4
culture 10.2
chairs 9.8
sofa 9.6
women 9.5
living 9.5
costume 9.4
happy 9.4
restaurant 9.3
entertainer 9.3
relax 9.3
face 9.2
classroom 9.2
decor 8.8
comfortable 8.6
men 8.6
dining 8.6
smile 8.5
senior 8.4
relaxation 8.4
wood 8.3
inside 8.3
family 8
glass 7.8
art 7.7
elderly 7.7
mature 7.4
light 7.3
window 7.3
hall 7.3
armchair 7.3
aged 7.2
looking 7.2
wooden 7
salon 7

Google
created on 2021-04-03

Forehead 98.5
Cheek 97.9
Head 97.2
Chin 96.7
Eyebrow 95.1
Hairstyle 95.1
Facial expression 93.2
Jaw 88
Art 81.7
Tints and shades 77.2
Vintage clothing 73.5
Visual arts 66.8
Circle 66.5
Self-portrait 65.7
Painting 63.5
Portrait 62.3
Room 61.7
Monochrome 61.4
History 61.4
Illustration 59.5

Microsoft
created on 2021-04-03

human face 98.4
text 97.3
black 94.2
drawing 93.2
person 93
old 91.8
white 91.3
sketch 90.1
indoor 87.7
portrait 77.9
painting 66.3
vintage 60.5
picture frame 7.1

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 13-25
Gender Male, 84.5%
Calm 85%
Happy 7.9%
Confused 4%
Sad 1.8%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Fear 0.2%

Microsoft Cognitive Services

Age 13
Gender Female

Feature analysis

Amazon

Person 77.3%

Captions

Microsoft

a vintage photo of a person 72.2%
a vintage photo of a box 66.2%
a vintage photo of a sign 66.1%