Human Generated Data

Title

Untitled (two unidentified children, both wearing large lace collars)
Date

1866-1900
People

Artist: W. G. Weatherup, American active mid-19th to early-20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3852

Human Generated Data

Title

Untitled (two unidentified children, both wearing large lace collars)

People

Artist: W. G. Weatherup, American active mid-19th to early-20th century

Date

1866-1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3852

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 95.4
Human 95.4
Advertisement 94
Poster 93.5
Collage 90.6
Person 89.4
Art 78.8
Label 75.8
Text 75.8
Drawing 61.2
Canvas 58.1
Female 56.1
Girl 56.1

Clarifai
created on 2019-11-16

retro 98.5
wear 98.4
people 97.4
vintage 96.8
dirty 96.1
antique 95.6
paper 95.4
art 94.5
portrait 93.7
desktop 93.3
child 93.3
blank 91.9
picture frame 91.6
old 90.6
sepia 90.5
page 90.1
two 90
nostalgia 89.8
texture 89.2
sepia pigment 88.8

Imagga
created on 2019-11-16

vintage 65.5
grunge 64.8
old 63.5
frame 62.5
paper 61.2
antique 59.9
texture 54.9
retro 54.1
empty 52.4
aged 51.6
border 46.2
ancient 45.9
blank 43.9
parchment 36.5
wallpaper 35.3
page 30.7
damaged 30.6
material 30.5
rough 30.1
dirty 29.9
brown 29.5
grungy 29.4
aging 28.8
canvas 27.5
art 26.5
sheet 26.3
old fashioned 25.7
notebook 25.5
design 25.1
stained 25
book 24.6
photograph 24.4
wall 24
stains 23.4
document 23.2
decay 23.2
cardboard 23.1
text 22.7
space 22.5
textured 21.9
backgrounds 21.9
rusty 21.9
burnt 21.4
crumpled 21.4
pattern 21.2
historic 21.1
cover 20.4
letter 20.2
worn 20.1
pages 19.6
grime 19.6
ragged 19.5
snapshot 19.5
grain 19.4
spot 19.2
broad 18.7
fracture 18.5
backdrop 18.1
mottled 17.6
film 16.6
album 16.6
torn 16.5
decorative 15.9
structure 15.8
manuscript 15.7
tracery 15.6
succulent 15.6
graphic 15.3
faded 14.6
history 13.4
black 13.4
yellow 13.3
crease 12.7
crack 12.6
dirt 12.4
weathered 12.4
screen 12.2
paint 11.8
messy 11.6
stain 11.5
decoration 11.2
color 11.1
shabby 10.8
memory 10.6
museum 10.1
photographic 9.8
sepia 9.7
style 9.7
edge 9.6
obsolete 9.6
creation 9.6
textures 9.5
representation 9.4
covering 9.3
element 9.1
highly 8.9
scratches 8.9
instant 8.9
frames 8.8
scratch 8.8
artistic 8.7
rust 8.7
detailed 8.7
age 8.6
dark 8.4
burned 7.9
scratched 7.8
child 7.8
nobody 7.8
scrapbook 7.8
photography 7.6
camera 7.4
note 7.4
card 7.3

Google
created on 2019-11-16

Photograph 96.8
Vintage clothing 58
Paper product 53.3
Portrait 51.6
Square 50.6
Art 50.2

Microsoft
created on 2019-11-16

text 98.5
human face 98.4
person 96
painting 94.8
clothing 84
drawing 78.9
portrait 74.4
girl 54.4
woman 52.3
old 45.5
picture frame 16.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 89.9%
Fear 0.1%
Calm 92.9%
Disgusted 0.4%
Angry 3%
Surprised 0.4%
Happy 0.8%
Sad 1.7%
Confused 0.7%

AWS Rekognition

Age 1-7
Gender Male, 76.7%
Angry 14.9%
Calm 80.3%
Confused 1%
Disgusted 0.3%
Surprised 0.9%
Happy 1.4%
Sad 0.9%
Fear 0.3%

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.4%

Categories

Imagga

paintings art 95%
food drinks 1.8%
people portraits 1.2%

Captions

Microsoft
created on 2019-11-16

a black sign with white text 48.6%
a black sign with white letters 45.6%
a white sign with black text 45.5%

Text analysis

Amazon

7keatherup,
2.2003.385a
WIINIT

Google

heathinup WESTFIELD, N. Y. 2.2003,3858
heathinup
WESTFIELD,
N.
Y.
2.2003,3858