Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (man wearing hat, seated in chair, holding wooden stick)

Date

c. 1880-c. 1889

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.5

Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (man wearing hat, seated in chair, holding wooden stick)

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Date

c. 1880-c. 1889

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 97.2
Person 97.2
Clothing 95.8
Apparel 95.8
Furniture 94.9
Sitting 94.9
Chair 93.4
Hat 91.6
Coat 78.9
Suit 78.9
Overcoat 78.9
Text 74.6
Portrait 66.7
Photo 66.7
Photography 66.7
Face 66.7
Art 62.3
Female 58.7
Footwear 56.5

Imagga
created on 2022-02-25

crutch 38
person 35.4
scholar 29.5
staff 29.4
adult 25.9
sexy 24.1
intellectual 23.6
stick 23.4
attractive 23.1
fashion 21.9
portrait 21.3
model 21
people 19.5
hat 18.6
body 18.4
pretty 18.2
man 18.1
black 17.7
dark 16.7
male 16.3
lady 16.2
posing 16
style 15.6
clothing 15.3
hair 15.1
one 14.9
wall 14.5
human 14.2
dress 13.5
sensual 12.7
face 12.1
sensuality 11.8
lovely 11.5
cowboy hat 11.3
studio 10.6
sitting 10.3
elegance 10.1
pose 10
vintage 9.9
chair 9.8
old 9.7
standing 9.6
erotic 9.4
elegant 9.4
happy 9.4
lifestyle 9.4
skin 9.3
room 9.1
building 8.7
headdress 8.7
brunette 8.7
sexual 8.7
cute 8.6
suit 8.6
looking 8
interior 8
smile 7.8
hand 7.6
window 7.4
covering 7.4
water 7.3
alone 7.3
dirty 7.2
military uniform 7.2
women 7.1
musical instrument 7.1
businessman 7.1

Google
created on 2022-02-25

Chair 91.4
Hat 89.5
Collar 83
Fedora 80.9
Tints and shades 76.9
Blazer 76.7
Sun hat 76.2
Suit 75.5
Vintage clothing 73.7
Sitting 65.6
Formal wear 62.4
Boot 62.3
Stock photography 62.2
Vintage advertisement 60.2
Sleeve 55.9
Room 55.6
Retro style 55.1
Art 54.8
Portrait 54.4
Classic 54.3

Microsoft
created on 2022-02-25

text 99.8
clothing 98.8
hat 97
fashion accessory 95.8
person 95.7
man 93.9
old 90.9
fedora 88.9
cowboy hat 81.6
white 71.2
furniture 69.8
human face 67.2
chair 66.9
footwear 57.2
posing 55.9
photograph 52.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 73.7%
Confused 17.9%
Surprised 2.4%
Sad 2.1%
Fear 1.8%
Angry 1.3%
Disgusted 0.5%
Happy 0.3%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%
Hat 91.6%
Suit 78.9%

Captions

Microsoft

a vintage photo of a man 89.8%
a vintage photo of a man in a suit and tie 89.7%
an old photo of a man 89.6%