Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (barefoot man with beard wearing hat, facing front, basket of fruit in right hand, holding sack slung over shoulders with left)

Date

c. 1880-c. 1889

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1985.29.24

Human Generated Data

Title

Costumes of Michaelenses, Azores, Portugal (barefoot man with beard wearing hat, facing front, basket of fruit in right hand, holding sack slung over shoulders with left)

People

Artist: A.J. Rapozo, Portuguese active mid- to late-19th century

Date

c. 1880-c. 1889

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-19

Person 99.4
Human 99.4
Clothing 98.8
Apparel 98.8
Hat 97
Basket 85.4
Plant 80.3
Coat 63.1
Face 62.4
Photo 61.4
Photography 61.4
Portrait 60.2
Overcoat 60.1
Art 59.9
Food 59.7
Fruit 59.7

Imagga
created on 2022-02-19

statue 28.1
sculpture 25.7
hat 25.1
sombrero 20.7
headdress 19.4
clothing 16.4
man 16.1
old 16
religion 14.3
stone 14.3
male 14.3
portrait 14.2
monument 14
people 13.9
ancient 13.8
person 13.8
architecture 13.4
art 13.3
historical 13.2
history 12.5
adult 12.3
antique 12.2
face 12.1
culture 12
marble 11.9
black 11
world 10.8
tourism 10.7
cowboy hat 10.7
god 9.6
love 9.5
religious 9.4
travel 9.2
vintage 9.1
sexy 8.8
covering 8.6
grunge 8.5
historic 8.2
dress 8.1
posing 8
building 7.9
consumer goods 7.9
couple 7.8
catholic 7.8
head 7.6
dark 7.5
human 7.5
traditional 7.5
city 7.5
one 7.5
column 7.5
famous 7.4
style 7.4
decoration 7.3
dirty 7.2
landmark 7.2

Google
created on 2022-02-19

Microsoft
created on 2022-02-19

text 99.6
clothing 97.8
person 93.1
hat 86.8
man 83.4
fashion accessory 74.3
white 69.9
human face 65.4
old 64.5
posing 45
picture frame 7.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Fear 43.4%
Surprised 21.2%
Calm 21%
Confused 9.5%
Angry 2%
Sad 1.1%
Happy 0.9%
Disgusted 0.8%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 97%

Captions

Microsoft

a vintage photo of a man 79.1%
a vintage photo of a man standing in front of a box 65.4%
a vintage photo of a man wearing a hat 65.3%