Human Generated Data

Title

Untitled (young man in brocade vest, seated, three-quarter length)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3872

Human Generated Data

Title

Untitled (young man in brocade vest, seated, three-quarter length)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 97.9
Human 97.9
Art 95
Painting 95
Apparel 91.6
Clothing 91.6
Mirror 75.2
Photography 66.5
Portrait 66.5
Face 66.5
Photo 66.5
Glasses 61.1
Accessory 61.1
Accessories 61.1
Lingerie 55.8
Underwear 55.8

Imagga
created on 2022-01-29

shield 85.6
armor 68
protective covering 51.5
antique 35
covering 34.6
gold 34.6
art 31.7
old 30.7
frame 27
vintage 26.5
ancient 26
decoration 24.7
golden 24.1
religion 21.5
history 19.7
retro 19.7
culture 18
design 17.5
wall 17.1
architecture 16.6
ornate 16.5
amulet 16.3
paper 15.7
sculpture 14.8
blank 14.6
detail 14.5
money 14.5
pattern 14.4
currency 14.4
religious 14.1
rich 14
palace 13.7
grunge 13.6
border 13.6
finance 13.5
bank 13.4
decorative 13.4
statue 13.3
heraldry 13.2
ornament 12.9
charm 12.9
historic 12.9
style 12.6
church 12
close 12
banking 12
wealth 11.7
financial 11.6
interior 11.5
museum 11.4
metal 11.3
one 11.2
empty 11.2
dollar 11.1
cash 11
carved 10.8
face 10.7
decor 10.6
mail 10.5
god 10.5
post 10.5
texture 10.4
classic 10.2
closeup 10.1
wood 10
temple 10
traditional 10
aged 10
landmark 9.9
collection 9.9
postage 9.8
stamp 9.7
carving 9.6
travel 9.2
business 9.1
painting 9
deco 8.8
building 8.8
symbol 8.8
worship 8.7
prayer 8.7
spirituality 8.6
exchange 8.6
ornamental 8.6
stone 8.4
portrait 8.4
east 8.4
letter 8.3
mosaic 8.1
brown 8.1
textured 7.9
postmark 7.9
postal 7.9
baroque 7.8
banknote 7.8
pray 7.8
royal 7.7
luxury 7.7
us 7.7
decorated 7.7
door 7.6
historical 7.5
savings 7.5
framework 7.5
famous 7.5
object 7.3
black 7.2
icon 7.1
silver 7.1
wooden 7

Google
created on 2022-01-29

Head 97.2
Picture frame 89.8
Art 83
Painting 72.6
Vintage clothing 70.1
History 67.4
Visual arts 65.3
Stock photography 63.2
Holy places 62.8
Oval 62.6
Antique 61.5
Monarch 60.7
Portrait 56.6
Circle 53.3

Microsoft
created on 2022-01-29

person 97.9
clothing 97.4
human face 96.2
man 85.3
victorian 74.7
old 68.8
picture frame 62.1
painting 30.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 54.3%
Confused 17.6%
Surprised 15.2%
Sad 5.2%
Fear 3.1%
Angry 1.9%
Disgusted 1.4%
Happy 1.4%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Painting 95%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 83.9%
a person standing in front of a mirror posing for the camera 71.9%
a person posing for a photo in front of a mirror 71.8%