Human Generated Data

Title

Untitled (four people on a porch, cat on lap of seated man)

Date

c. 1870-c. 1890

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.73

Human Generated Data

Title

Untitled (four people on a porch, cat on lap of seated man)

People

Artist: Unidentified Artist,

Date

c. 1870-c. 1890

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.367.73

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99
Human 99
Person 97
Nature 91.6
Building 84.9
Art 84.1
Painting 84.1
Outdoors 82.8
Architecture 80.1
Person 77.1
Housing 76.6
Person 73.4
Soil 64.6
Tower 63.7
Landscape 59.1
Temple 58.1
Shrine 58.1
Worship 58.1
Clothing 55.6
Apparel 55.6

Clarifai
created on 2018-03-16

people 97.7
illustration 96.8
art 96.7
wear 96
print 95.9
paper 93.3
adult 92.2
painting 92
retro 91.6
vintage 90.9
no person 90.8
man 89.9
picture frame 88.8
antique 88.3
old 88.1
one 87.5
bill 87.3
desktop 84.9
text 81.5
group 81.2

Imagga
created on 2018-03-16

grunge 63.1
vintage 57.9
old 53.7
antique 49.4
texture 49.4
aged 48.9
envelope 45.6
paper 43.3
retro 42.6
frame 41.7
damaged 39.1
ancient 38.1
material 34
border 33.5
crumpled 31.1
container 30.9
dirty 29.8
parchment 29.8
stains 28.2
page 27.9
decay 27
grungy 26.6
space 25.6
wallpaper 25.3
wall 25.3
empty 24.9
text 24.5
grime 24.4
design 24.2
art 23.6
grain 23.1
historic 22.9
rusty 22.9
book 22.7
ragged 22.4
fracture 22.4
worn 22
rough 21
old fashioned 20.9
textures 20.9
structure 20.3
textured 20.2
graphic 19
manuscript 18.6
cardboard 18.3
spot 18.2
pattern 17.8
document 17.6
backdrop 16.5
your 16.4
blank 16.3
tracery 15.8
broad 15.7
mottled 15.6
succulent 15.6
stain 15.4
artistic 14.8
brown 14.7
shabby 14.7
torn 14.5
messy 14.5
decoration 14.2
binding 13.6
rust 13.5
drawing 13.3
backgrounds 13
floral 12.8
scratched 12.7
faded 12.7
crack 12.6
decorative 12.5
dirt 12.4
weathered 12.4
tattered 11.8
highly 11.8
graffito 11.8
crease 11.8
detailed 11.6
aging 11.5
obsolete 11.5
book jacket 11.5
canvas 11.4
letter 11
artwork 11
paint 10.9
scratch 10.7
album 10.7
burnt 10.7
sepia 10.7
architecture 10.3
flower 10
film 10
jacket 9.9
photographic 9.8
screen 9.8
ornament 9.5
sheet 9.4
leaf 9.3
product 9.3
board 9.2
stucco 9.2
black 9
color 8.9
slide 8.8
scrapbook 8.7
concrete 8.6
cover 8.3
style 8.2
world 8.2
history 8.1
detail 8.1
surface 7.9
distressed 7.9
frames 7.8
uneven 7.8
strip 7.8
movie 7.8
beige 7.7
collage 7.7
stained 7.7
element 7.4
covering 7.4
global 7.3
creation 7.3
gray 7.2
card 7.2

Google
created on 2018-03-16

text 85.2
picture frame 71.4
art 66.7
painting 59.3
artwork 57.7
history 53.6
visual arts 53.3
drawing 52.8

Microsoft
created on 2018-03-16

old 58.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Angry 45.8%
Disgusted 46.5%
Happy 45.5%
Sad 45.8%
Calm 50.5%
Confused 45.3%
Surprised 45.7%

AWS Rekognition

Age 35-52
Gender Male, 50.8%
Happy 45%
Angry 45.1%
Disgusted 45%
Calm 45.2%
Sad 54.6%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 49.6%
Disgusted 50.3%
Calm 49.5%
Happy 49.5%
Sad 49.6%
Surprised 49.5%
Confused 49.5%

Feature analysis

Amazon

Person 99%
Painting 84.1%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2018-03-16

an old photo of a box 30.2%
an old photo of a person 26.6%
an old photo of a refrigerator 10.7%