Human Generated Data

Title

Untitled (portrait of two children)
Date

1860s
People

Artist: N. T. Morse, American 19th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2692

Human Generated Data

Title

Untitled (portrait of two children)

People

Artist: N. T. Morse, American 19th century

Date

1860s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2692

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Face 98.8
Human 98.8
Clothing 97.8
Apparel 97.8
Person 95
Head 92.3
Bonnet 92.2
Hat 92.2
Person 90.2
Portrait 70.6
Photography 70.6
Photo 70.6
Text 68.4
Icing 64.5
Food 64.5
Dessert 64.5
Cake 64.5
Cream 64.5
Creme 64.5
Girl 60.6
Female 60.6
Sketch 59
Art 59
Drawing 59
Kid 58
Child 58
Outdoors 58
Home Decor 57
People 55.9

Clarifai
created on 2023-10-25

portrait 99.8
sepia 99.8
people 99.6
sepia pigment 98.7
vintage 97.7
old 97.4
son 96.9
wear 96.7
child 96.4
art 96.4
retro 96
affection 95.1
paper 95
two 94.4
scan 92.2
antique 91.2
facial expression 91
one 88.9
offspring 88.9
painting 87.9

Imagga
created on 2021-12-14

child 39.7
portrait 27.8
face 27
mother 26.8
happy 26.3
people 25.1
parent 24.8
love 24.5
man 23.5
family 23.1
male 23
attractive 22.4
hair 22.2
adult 20.7
world 20.5
smile 19.9
happiness 19.6
baby 19.6
person 19.3
couple 19.2
smiling 18.8
daughter 18.6
body 16.8
eyes 16.3
kid 16
father 15.8
sibling 15.7
care 15.6
boy 14.8
skin 14.5
sexy 14.5
dad 14.2
pretty 14
girls 13.7
childhood 13.4
health 13.2
cute 12.9
human 12.7
healthy 12.6
son 12.5
lifestyle 12.3
relationship 12.2
black 12
looking 12
home 12
newborn 11.7
bath 11.4
clothing 11.3
fun 11.2
expression 11.1
brother 11.1
youth 11.1
bathroom 10.8
little 10.6
one 10.4
casual 10.2
relax 10.1
head 10.1
wet 9.8
lady 9.7
together 9.6
toddler 9.5
life 9.5
men 9.4
water 9.3
spa 9
blond 8.9
brunette 8.7
covering 8.7
hands 8.7
infant 8.7
husband 8.6
two 8.5
relaxation 8.4
indoor 8.2
handsome 8
brassiere 7.9
plaything 7.9
guy 7.8
affection 7.7
resting 7.6
hand 7.6
dream 7.6
togetherness 7.6
clean 7.5
grandma 7.5
leisure 7.5
doll 7.4
close 7.4
teen 7.4
teenager 7.3
women 7.1
lovely 7.1
look 7

Google
created on 2021-12-14

Nose 98.4
Cheek 97.9
Chin 96.7
Hairstyle 95.1
Eyebrow 95
Jaw 87.9
Art 86
Gesture 85.3
Headgear 80.9
Vintage clothing 78
Happy 74.8
Child 74.7
Illustration 68.4
Monochrome 67.2
Room 65.5
Toddler 65.1
Painting 65.1
Portrait 62.5
Paper product 62.4
Visual arts 61.7

Microsoft
created on 2021-12-14

wall 98.4
toddler 97.8
human face 97.5
baby 97.2
person 92.1
child 91.7
old 90
indoor 89.2
text 86.9
clothing 74
sketch 71
drawing 65.9
boy 61.6
portrait 58.1
posing 48.1
vintage 40.8
picture frame 35.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 95.8%
Calm 95.1%
Angry 1.5%
Sad 1.5%
Happy 0.8%
Surprised 0.4%
Confused 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Male, 86.2%
Calm 98%
Sad 1%
Confused 0.3%
Surprised 0.3%
Angry 0.3%
Happy 0.1%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95%

Categories

Imagga

paintings art 91.1%
people portraits 8.6%

Captions

Microsoft
created on 2021-12-14

a vintage photo of a girl 73%
a vintage photo of a person 72.9%
a vintage photo of a boy 59.3%