Human Generated Data

Title

Costumes of Fayal Island, Azores, Portugal (bearded man standing, leaning on wooden stake, legs crossed at ankles, balancing large bundle on left shoulder)

Date

c. 1880-c. 1889

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.28

Human Generated Data

Title

Costumes of Fayal Island, Azores, Portugal (bearded man standing, leaning on wooden stake, legs crossed at ankles, balancing large bundle on left shoulder)

People

Artist: Unidentified Artist,

Date

c. 1880-c. 1889

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99.3
Human 99.3
Art 75.9
Apparel 65
Clothing 65
Drawing 64.1
Photo 62.4
Photography 62.4
Painting 58.8
Face 56.4

Imagga
created on 2022-02-25

paper 32.3
toilet tissue 26.7
grunge 24.7
old 24.4
texture 23.6
vintage 22.3
tissue 22.3
ancient 20.8
antique 20.1
aged 17.2
art 17
wallpaper 16.8
sculpture 15.3
stone 14.5
travel 14.1
retro 13.9
document 13.9
empty 13.7
culture 13.7
frame 13.3
sand 12.8
rough 12.8
brown 12.5
cardboard 12.5
parchment 12.5
blank 12
design 12
letter 11.9
dirty 11.7
history 11.6
aging 11.5
textured 11.4
backgrounds 11.4
architecture 11.1
pattern 10.9
head 10.9
decorative 10.9
dress 10.8
statue 10.8
face 10.7
canvas 10.4
sheet 10.3
monument 10.3
page 10.2
decoration 9.9
artistic 9.6
worn 9.5
color 9.5
cover 9.2
tourism 9.1
stucco 9.1
portrait 9.1
romantic 8.9
manuscript 8.8
wall 8.8
bride 8.6
old fashioned 8.6
covering 8.5
element 8.3
tourist 8.3
historic 8.2
style 8.2
landmark 8.1
religion 8.1
material 8
light 8
bright 7.9
line 7.8
model 7.8
column 7.6
weathered 7.6
grungy 7.6
elegance 7.6
book 7.5
fashion 7.5
historical 7.5
traditional 7.5
famous 7.4
black 7.4
lampshade 7.3
border 7.2
building 7.1

Google
created on 2022-02-25

Brown 98
Sleeve 86.6
Wood 84.2
Art 81.8
Rectangle 81.1
Tints and shades 77.4
Vintage clothing 71.5
Visual arts 69.1
Painting 64.5
Paper 63.5
Illustration 62.6
Stock photography 62.1
Drawing 61.9
Paper product 61.8
Font 57
History 56.9
Antique 54.6
Room 53.2
Monochrome 52.3

Microsoft
created on 2022-02-25

text 98.9
clothing 98.1
person 96.5
old 85.3
posing 84.8
man 78.9
photograph 78.8
black 76.8
white 75.7
human face 60.8
vintage 48.3
picture frame 25.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Angry 86.8%
Confused 4.4%
Calm 4.2%
Sad 1.2%
Surprised 1.1%
Disgusted 1.1%
Fear 0.7%
Happy 0.6%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a vintage photo of a person 83.4%
a vintage photo of a person standing posing for the camera 77.8%
an old photo of a person 77.7%