Human Generated Data

Title

Untitled (Flora Newman's mother)
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2904

Human Generated Data

Title

Untitled (Flora Newman's mother)

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.1
Human 98.1
Art 96.6
Drawing 93.2
Sketch 86.3
Painting 73.8
Face 68.3
Photography 61.3
Photo 61.3
Portrait 58.8

Imagga
created on 2022-01-08

stethoscope 38.5
attractive 38.5
adult 38.3
model 38.1
portrait 36.3
face 34.8
person 33.8
hair 33.3
pretty 32.2
medical instrument 31.5
sexy 29.7
lady 29.2
fashion 27.9
instrument 24.9
people 24.6
youth 23.9
device 23.8
brunette 23.5
eyes 19.8
women 19.8
expression 18.8
skin 18.2
posing 17.8
looking 17.6
happy 17.6
pose 17.2
smile 17.1
studio 16.7
body 16
gorgeous 15.4
cute 15.1
style 14.8
smiling 14.5
dress 14.5
human 14.3
one 14.2
black 14
blond 13.7
confident 13.7
makeup 13.6
sensuality 13.6
casual 13.6
lovely 13.3
sensual 12.7
businesswoman 12.7
head 11.8
clothing 11.6
lifestyle 11.6
fashionable 11.4
professional 11.3
20s 11
friendly 11
happiness 11
stylish 10.9
glamor 10.5
look 10.5
business 10.3
clothes 10.3
elegant 10.3
lips 10.2
braid 10.1
indoors 9.7
healthy 9.5
long 9.2
modern 9.1
make 9.1
single 9
health 9
shirt 8.9
standing 8.7
hairstyle 8.6
females 8.5
wall clock 8.5
feminine 8.4
elegance 8.4
dark 8.4
care 8.2
alone 8.2
cheerful 8.1
necktie 8.1
child 7.9
color 7.8
hand 7.6
one person 7.5
holding 7.4
glasses 7.4
natural 7.4
jacket 7.2
interior 7.1
bow tie 7
garment 7

Google
created on 2022-01-08

Lip 96.8
Eyebrow 93.7
Eyelash 88.9
Jaw 88
Neck 87.6
Sleeve 87.2
Headgear 82
Art 81.7
Tints and shades 77.3
Vintage clothing 71.6
Self-portrait 69.7
Fashion design 68.2
Painting 67.8
Visual arts 66.4
Room 64.7
Monochrome 63.6
Jewellery 62.7
Monochrome photography 61.4
Headpiece 60.8
Drawing 60.6

Microsoft
created on 2022-01-08

text 97.6
human face 97.3
wall 96.7
sketch 95.3
drawing 95.1
person 92.8
portrait 85.1
woman 84.5
clothing 79.1
painting 68.5
document 17.2

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 98.9%
Happy 0.3%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%
Sad 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a close up of a person 63%
close up of a person 58%