Human Generated Data

Title

Untitled (young man with patterned vest, bust-length, front view)
Date

1840s-1850s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.9

Human Generated Data

Title

Untitled (young man with patterned vest, bust-length, front view)

People

Artist: Unidentified Artist,

Date

1840s-1850s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.9

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Tie 99.1
Accessories 99.1
Accessory 99.1
Human 95.4
Person 95.4
Tie 93
Apparel 90.9
Clothing 90.9
Art 84.1
Brick 83
Coat 77.3
Overcoat 77.3
Suit 77.3
Jar 59.5
Poster 56
Collage 56
Advertisement 56
Photography 55.1
Photo 55.1

Clarifai
created on 2019-11-05

people 99.3
painting 98.6
art 97.7
adult 97.5
man 97.4
portrait 97.2
one 95.9
woman 95.2
retro 94.1
print 93.2
vintage 92.8
wear 92.8
illustration 92.4
leader 91.6
antique 91
old 90.4
monarch 90
religion 84.2
post 82.8
facial expression 81.2

Imagga
created on 2019-11-05

prayer rug 98.8
rug 79.8
floor cover 59.8
furnishing 59.4
covering 42.8
old 38.3
vintage 35.6
art 30.4
retro 24.6
antique 24.2
mosaic 22.1
grunge 22.1
ancient 20.7
frame 20.1
postage 19.7
paper 19.6
stamp 19.4
mail 19.1
decoration 18.2
post 18.1
museum 17.5
letter 17.4
gold 17.3
religion 17
postmark 16.8
postal 15.7
culture 15.4
texture 15.3
design 15.2
wall 14.7
ornate 13.7
paintings 13.7
envelope 13.6
icon 13.5
symbol 13.5
history 13.4
painter 13
transducer 12.5
pattern 12.3
empty 12
masterpiece 11.9
printed 11.8
aged 11.8
wallpaper 11.5
religious 11.2
blank 11.1
church 11.1
historic 11
shows 10.8
renaissance 10.8
artist 10.6
style 10.4
golden 10.3
architecture 10.1
border 10
stamps 9.9
delivery 9.7
interior 9.7
one 9.7
close 9.7
office 9.6
black 9.6
saint 9.6
brown 9.6
painted 9.5
fine 9.5
worn 9.5
unique 9.5
electrical device 9.4
face 9.2
decorative 9.2
wood 9.2
painting 9
currency 9
post mail 8.9
zigzag 8.9
fame 8.9
known 8.9
cutting 8.7
communications 8.6
obsolete 8.6
portrait 8.4
global 8.2
device 8.2
dirty 8.1
closeup 8.1
detail 8
philately 7.9
gallery 7.9
letters 7.7
god 7.7
money 7.7
rusty 7.6
book 7.5
classic 7.4
business 7.3
paint 7.2
collection 7.2
sculpture 7.1
wooden 7
textured 7

Google
created on 2019-11-05

Picture frame 90
Painting 74.2
Portrait 65.9
Gentleman 65.1
Art 62.5
Visual arts 59.3

Microsoft
created on 2019-11-05

wall 96.4
indoor 95.8
human face 95.7
person 92.8
text 84.3
clothing 82.1
man 80
old 40.4
picture frame 37.8
painting 30.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Male, 99.6%
Happy 0.1%
Confused 0.2%
Disgusted 0%
Surprised 0%
Fear 0%
Calm 99.5%
Angry 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 95.4%

Categories

Imagga

events parties 69.4%
people portraits 14.5%
paintings art 11.3%
food drinks 1.3%
interior objects 1.3%

Captions

Microsoft
created on 2019-11-05

a painting of a person 74.3%
a painting on the wall 64.2%
a painting on a wall 63%