Human Generated Data

Title

Untitled (young woman, seated, rural backdrop, bouquet of flowers on ground to right)

Date

1866-1899

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.4094

Human Generated Data

Title

Untitled (young woman, seated, rural backdrop, bouquet of flowers on ground to right)

People

Artist: Unidentified Artist,

Date

1866-1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 99.1
Human 99.1
Poster 97.2
Advertisement 97.2
Art 88.4
Painting 73.3
Furniture 65.2
Drawing 58.6
Clothing 56
Apparel 56
Baby 55.6

Clarifai
created on 2019-11-10

people 98.8
vintage 96.8
portrait 96.6
art 96.1
retro 95.7
child 95.6
illustration 94.5
paper 93.3
print 92.9
girl 91.6
nature 91.2
old 89.4
one 88.1
book bindings 86.7
adult 86.1
antique 85.1
square 82
smoke 81.4
baby 80.4
tree 80.2

Imagga
created on 2019-11-10

book jacket 32.4
jacket 26.2
people 21.8
wrapping 19.2
man 19
sexy 17.7
portrait 16.8
adult 16.8
attractive 16.8
body 16
person 15.1
male 14.9
sand 14.4
face 14.2
grunge 13.6
pretty 13.3
model 13.2
statue 13
covering 13
fashion 12.8
black 12.8
art 11.7
vintage 11.6
antique 11.3
human 11.2
old 11.1
love 11.1
outdoor 10.7
lady 10.6
hair 10.3
skin 10.3
wall 10.3
lifestyle 10.1
sensual 10
silhouette 9.9
soil 9.8
kin 9.8
child 9.6
ancient 9.5
culture 9.4
architecture 9.4
sculpture 9.2
figure 9.2
hand 9.1
religion 9
structure 9
posing 8.9
earth 8.7
dark 8.4
world 8.2
sport 8.2
light 8.2
one 8.2
sensuality 8.2
history 8.1
looking 8
cute 7.9
brunette 7.8
erotic 7.7
expression 7.7
head 7.6
power 7.6
relaxation 7.5
leisure 7.5
decoration 7.4
emotion 7.4
artwork 7.3
dirty 7.2
design 7.2
sunset 7.2
romantic 7.1
lovely 7.1
summer 7.1
sky 7

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 99.8
clothing 97.7
person 97.4
baby 95.1
child 94.7
human face 93.4
toddler 93.3
painting 68.4
smile 66.3
boy 55.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 86.7%
Happy 0.1%
Sad 2.5%
Disgusted 0.1%
Angry 0.8%
Surprised 0.2%
Fear 0.1%
Calm 95.8%
Confused 0.4%

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Poster 97.2%

Captions

Microsoft

a vintage photo of a person 75%
a vintage photo of a person holding a book 44.7%
a vintage photo of a book 42.8%