Human Generated Data

Title

Untitled (unidentified young woman, head covered, resting basket on right hip)
Date

1860-1899
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.35

Human Generated Data

Title

Untitled (unidentified young woman, head covered, resting basket on right hip)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Apparel 98.4
Clothing 98.4
Person 96.3
Human 96.3
Art 86.1
Female 82.9
Woman 66.7
Painting 64.4
Portrait 63.4
Photo 63.4
Face 63.4
Photography 63.4
Drawing 57.6
Bonnet 56.9
Hat 56.9

Imagga
created on 2022-02-25

swab 100
cleaning implement 100
old 28.5
antique 20.8
vintage 19.8
sculpture 19.7
statue 18.3
ancient 18.1
texture 17.4
architecture 15.6
grunge 15.3
wall 13.7
art 13.3
brown 13.2
retro 12.3
aged 11.8
detail 11.3
building 11.1
historic 11
wood 10.8
historical 10.3
paper 10.2
dress 9.9
history 9.8
rusty 9.5
stone 9.3
monument 9.3
dirty 9
religion 9
wooden 8.8
face 8.5
travel 8.4
page 8.3
city 8.3
rough 8.2
paint 8.1
material 8
design 7.9
catholic 7.8
sepia 7.8
damaged 7.6
weathered 7.6
pattern 7.5
religious 7.5
frame 7.5
famous 7.4
artwork 7.3
decoration 7.2

Google
created on 2022-02-25

Sleeve 87.2
Art 81.7
Headgear 81
Vintage clothing 73.5
Visual arts 70.4
Rectangle 70
Painting 69.8
Fashion design 67
Costume design 64.2
Room 63.1
History 60.9
Illustration 60.1
Drawing 57.4
Paper product 57.2
Peach 56.4
Paper 56
Chest 55.7
Retro style 55.6
Sitting 55.3
Monochrome 54.8

Microsoft
created on 2022-02-25

clothing 98.5
person 98.1
text 97
woman 94.2
drawing 89.3
old 87.6
picture frame 86.4
white 84.8
posing 82.8
black 80.2
gallery 79.4
sketch 77.9
human face 76.8
painting 66.5
dress 64.8
room 59.8
poster 56.1
cartoon 54.6
vintage 36.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Female, 97.9%
Angry 96%
Sad 1.6%
Confused 0.6%
Fear 0.5%
Surprised 0.4%
Disgusted 0.4%
Calm 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.3%

Captions

Microsoft

a vintage photo of a person 86.7%
a vintage photo of a person standing posing for the camera 81.9%
a vintage photo of a girl 72%