Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (man wearing hat, seated in chair, holding wooden stick)
Date

c. 1880-c. 1889
People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.5

Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (man wearing hat, seated in chair, holding wooden stick)

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Date

c. 1880-c. 1889

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.5

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 97.2
Human 97.2
Clothing 95.8
Apparel 95.8
Furniture 94.9
Sitting 94.9
Chair 93.4
Hat 91.6
Suit 78.9
Coat 78.9
Overcoat 78.9
Text 74.6
Portrait 66.7
Photography 66.7
Face 66.7
Photo 66.7
Art 62.3
Female 58.7
Footwear 56.5

Clarifai
created on 2023-10-28

people 99.6
lid 99.1
portrait 99.1
man 96.1
adult 95.6
one 95.4
art 94.6
wear 94
chair 92.7
veil 90.4
retro 88.9
seat 86.8
vintage 86.3
nostalgia 83.8
furniture 83.3
walking stick 82.9
old 81.1
elderly 78.2
street 77.6
mustache 76

Imagga
created on 2022-02-25

crutch 38
person 35.4
scholar 29.5
staff 29.4
adult 25.9
sexy 24.1
intellectual 23.6
stick 23.4
attractive 23.1
fashion 21.9
portrait 21.3
model 21
people 19.5
hat 18.6
body 18.4
pretty 18.2
man 18.1
black 17.7
dark 16.7
male 16.3
lady 16.2
posing 16
style 15.6
clothing 15.3
hair 15.1
one 14.9
wall 14.5
human 14.2
dress 13.5
sensual 12.7
face 12.1
sensuality 11.8
lovely 11.5
cowboy hat 11.3
studio 10.6
sitting 10.3
elegance 10.1
pose 10
vintage 9.9
chair 9.8
old 9.7
standing 9.6
erotic 9.4
elegant 9.4
happy 9.4
lifestyle 9.4
skin 9.3
room 9.1
building 8.7
headdress 8.7
brunette 8.7
sexual 8.7
cute 8.6
suit 8.6
looking 8
interior 8
smile 7.8
hand 7.6
window 7.4
covering 7.4
water 7.3
alone 7.3
dirty 7.2
military uniform 7.2
women 7.1
musical instrument 7.1
businessman 7.1

Google
created on 2022-02-25

Chair 91.4
Hat 89.5
Collar 83
Fedora 80.9
Tints and shades 76.9
Blazer 76.7
Sun hat 76.2
Suit 75.5
Vintage clothing 73.7
Sitting 65.6
Formal wear 62.4
Boot 62.3
Stock photography 62.2
Vintage advertisement 60.2
Sleeve 55.9
Room 55.6
Retro style 55.1
Art 54.8
Portrait 54.4
Classic 54.3

Microsoft
created on 2022-02-25

text 99.8
clothing 98.8
hat 97
fashion accessory 95.8
person 95.7
man 93.9
old 90.9
fedora 88.9
cowboy hat 81.6
white 71.2
furniture 69.8
human face 67.2
chair 66.9
footwear 57.2
posing 55.9
photograph 52.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 73.7%
Confused 17.9%
Surprised 2.4%
Sad 2.1%
Fear 1.8%
Angry 1.3%
Disgusted 0.5%
Happy 0.3%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Suit
Person 97.2%
Hat 91.6%
Suit 78.9%

Categories

Imagga

events parties 99.7%

Captions

Microsoft
created on 2022-02-25

a vintage photo of a man 89.8%
a vintage photo of a man in a suit and tie 89.7%
an old photo of a man 89.6%