Human Generated Data

Title

Untitled (man, seated, bust-length, front view)
Date

1840s-1850s
People

Artist: Meade Brothers Studio, American active 1840s-1850s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.15

Human Generated Data

Title

Untitled (man, seated, bust-length, front view)

People

Artist: Meade Brothers Studio, American active 1840s-1850s

Date

1840s-1850s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Human 98.8
Person 98.8
Art 98.2
Painting 98.2
Apparel 91.5
Clothing 91.5
Portrait 70.9
Photography 70.9
Photo 70.9
Face 70.9
Text 66.3

Clarifai
created on 2019-11-05

art 99.4
painting 99
gold 97.4
people 97.1
one 97
picture frame 97
antique 95.4
decoration 93.5
old 92.5
ornate 92.4
portrait 91.9
illustration 91.8
religion 91.6
gilt 91.1
museum 88.6
adult 86.9
symbol 86.3
image 86
desktop 86
ancient 85

Imagga
created on 2019-11-05

mosaic 56.1
antique 50.3
art 46.9
prayer rug 44.8
old 40.5
rug 35.7
vintage 33.1
frame 32.8
religion 31.4
ancient 28.6
furnishing 28.2
gold 27.2
floor cover 27.1
transducer 26.9
decoration 25.4
retro 22.1
ornate 22
religious 21.6
culture 21.4
design 20.8
architecture 20.3
electrical device 20.2
covering 20
golden 19.8
history 19.7
decorative 17.6
border 17.2
church 16.7
historic 16.5
pattern 16.4
wall 16.3
texture 16
interior 15.9
museum 15.7
style 15.6
blank 15.4
painting 15.4
grunge 15.3
post 15.3
wood 15
postage 14.8
stamp 14.5
binding 14.5
mail 14.4
antiquity 14.2
symbol 14.2
device 14
ornament 13.8
detail 13.7
aged 13.6
travel 13.4
temple 13.3
amulet 13
empty 12.9
postmark 12.8
postal 12.8
carved 12.7
paper 12.6
door 12.4
letter 11.9
icon 11.9
traditional 11.7
decor 11.5
tile 11.3
building 11.2
carving 10.9
paintings 10.8
entrance 10.6
wooden 10.6
god 10.5
decorate 10.5
ornamental 10.5
charm 10.3
sculpture 10.3
framework 10.3
creation 10
palace 9.9
painter 9.8
deco 9.8
baroque 9.8
holy 9.6
saint 9.6
spirituality 9.6
obsolete 9.6
home 9.6
decorated 9.6
old fashioned 9.5
close 9.1
tourism 9.1
portrait 9.1
landmark 9
collection 9
masterpiece 8.9
gilded 8.9
gallery 8.8
bible 8.8
object 8.8
frames 8.8
envelope 8.8
delivery 8.8
prayer 8.7
rustic 8.6
faith 8.6
fine 8.6
historical 8.5
east 8.4
rich 8.4
famous 8.4
clock 8.2
one 8.2
brown 8.1
metal 8.1
canceled 7.9
textured 7.9
shows 7.9
printed 7.9
renaissance 7.9
artistic 7.8
face 7.8
sacred 7.8
belief 7.8
catholic 7.8
gate 7.8
luxury 7.7
middle 7.7
painted 7.6
statue 7.6
classic 7.4
global 7.3
office 7.2
color 7.2
window 7.2

Google
created on 2019-11-05

Picture frame 97.4
Art 62.5
Antique 61.2
Portrait 58
Gentleman 54.5
Painting 50.4

Microsoft
created on 2019-11-05

wall 98.9
human face 96.7
person 96.5
museum 93.6
art 92.3
clothing 91
indoor 87.4
man 83.3
picture frame 75.7
mirror 70.9
text 65.5
gold 61.2
painting 55
old 46
fancy 37.9
decorated 34.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 44-62
Gender Male, 96.8%
Confused 13.9%
Angry 82.7%
Calm 1.9%
Disgusted 0.3%
Sad 0.7%
Happy 0.1%
Fear 0.1%
Surprised 0.3%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 98.2%

Captions

Microsoft

a painting of a person in front of a mirror posing for the camera 77.3%
a painting of a person in front of a mirror 76.1%
a person in front of a mirror posing for the camera 76%