Human Generated Data

Title

Untitled (post-mortem portrait of two children, Auburn, New York)
Date

1880s
People

Artist: Squyer Studio, American 1848 - 1905
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3618

Human Generated Data

Title

Untitled (post-mortem portrait of two children, Auburn, New York)

People

Artist: Squyer Studio, American 1848 - 1905

Date

1880s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3618

Machine Generated Data

Tags

Amazon
created on 2022-02-19

Human 97
Canvas 96.5
Person 96
Home Decor 90.5
Drawing 87.3
Art 87.3
Person 87
Blonde 80.6
Woman 80.6
Girl 80.6
Kid 80.6
Teen 80.6
Female 80.6
Child 80.6
Advertisement 73
Face 71.3
Poster 71
Clothing 66.7
Apparel 66.7
Photography 62.1
Photo 62.1
Dress 60.4
People 60.1
Baby 58.6
Mail 57.2
Envelope 57.2

Clarifai
created on 2023-10-28

portrait 99.2
people 99.1
baby 98.1
art 97.9
retro 96.9
vintage 96.7
old 96.3
wear 96.3
son 96.1
sepia 94
man 93.7
child 93.5
two 92.9
sepia pigment 92
girl 88.9
adult 86
illustration 86
affection 85.9
antique 85.7
offspring 85.1

Imagga
created on 2022-02-19

sketch 30.8
drawing 24
representation 23
portrait 20.7
currency 19.7
envelope 18.8
money 17.9
paper 17.6
person 17.1
vintage 16.5
people 15.6
cash 15.6
old 14.6
bank 14.5
hair 14.3
adult 14.2
face 14.2
symbol 14.1
model 14
black 13.5
container 13.3
bill 13.3
attractive 13.3
close 13.1
art 12.9
banking 12.9
human 12.7
one 12.7
banknote 12.6
business 12.1
closeup 12.1
economy 12.1
baby 11.9
jersey 11.7
antique 11.7
note 11
head 10.9
man 10.8
wealth 10.8
cute 10.8
financial 10.7
retro 10.7
sexy 10.4
dollar 10.2
finance 10.1
religion 9.9
fashion 9.8
clothing 9.8
ancient 9.5
stamp 9.3
savings 9.3
rich 9.3
studio 9.1
shirt 8.9
looking 8.8
hands 8.7
male 8.5
fetus 8.4
letter 8.3
garment 8
posing 8
postmark 7.9
printed 7.9
pretty 7.7
culture 7.7
expression 7.7
mail 7.7
exchange 7.6
hand 7.6
sign 7.5
style 7.4
investment 7.3
lady 7.3
market 7.1
skin 7

Google
created on 2022-02-19

Outerwear 95.2
Product 90.7
Sleeve 87.1
Gesture 85.3
Baby 83.1
Toddler 79.9
Tints and shades 75.7
Vintage clothing 73.6
Picture frame 69.2
Rectangle 69
Art 66
Font 61.9
Room 61.5
Child 61.4
Pattern 58.3
Love 54.3
Visual arts 50.5
Retro style 50.4
Portrait 50.3

Microsoft
created on 2022-02-19

text 97.7
baby 97.4
human face 96.9
clothing 96.3
person 95.5
toddler 94.2
child 92.3
white 65.6
old 61.4
posing 55.1
smile 52.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 60.7%
Calm 95.7%
Disgusted 0.8%
Sad 0.7%
Happy 0.7%
Confused 0.7%
Surprised 0.6%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 0-6
Gender Female, 95.7%
Calm 93.7%
Sad 4.5%
Disgusted 0.5%
Happy 0.4%
Angry 0.3%
Confused 0.3%
Fear 0.2%
Surprised 0.2%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 96%
Person 87%

Categories

Imagga

food drinks 54.3%
paintings art 45.4%

Captions

Microsoft
created on 2022-02-19

a vintage photo of a person 66.3%
a vintage photo of a box 62.8%
a vintage photo of a person in a box 54.1%