Human Generated Data

Title

Untitled (portrait of an infant)
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2906

Human Generated Data

Title

Untitled (portrait of an infant)

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2906

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Baby 93.5
Human 93.5
Cat 83
Animal 83
Mammal 83
Pet 83
Newborn 81.6
Furniture 79.3
Person 73.7

Clarifai
created on 2023-10-25

child 97.8
dog 97.4
baby 97.1
portrait 96.3
cat 96.2
son 95.6
people 95.1
mammal 94.8
nude 94.4
two 94.2
one 93.3
girl 93
canine 90.3
winter 89.8
landscape 86.4
pet 85.8
snow 83.9
newborn 83.5
bird 83.3
family 81.6

Imagga
created on 2022-01-08

child 43.5
sand 37
soil 30.7
cute 28
dog 27.7
baby 25.3
brother 25.2
person 24.8
childhood 24.2
people 23.4
face 22.7
portrait 22.7
little 22.1
pretty 21.7
sexy 21.7
earth 21.6
body 21.6
care 20.6
domestic animal 20.4
canine 20
kid 19.5
hair 19
happiness 18.8
boy 18.3
bed 18
skin 17.8
relaxation 17.6
adult 17.5
innocent 17.5
one 17.2
smile 17.1
happy 16.9
lying 16.9
smiling 16.6
lifestyle 16.6
love 16.6
attractive 16.1
infant 15.4
innocence 15.4
women 15
indoors 14.9
blond 14.7
human 14.3
sofa 14.2
cheerful 13.8
newborn 13.6
home 13.6
lovely 13.3
healthy 13.2
clean 12.5
health 12.5
bath 12.3
fashion 12.1
eyes 12.1
mother 11.9
sweet 11.9
life 11.7
joy 11.7
spa 11.7
family 11.6
toddler 11.5
lady 11.4
expression 11.1
room 10.9
hand 10.6
parent 10.5
looking 10.4
head 10.1
sleeping 9.7
fun 9.7
sleep 9.7
relax 9.3
quilt 9.3
adorable 9.2
nice 9.2
children 9.1
relaxing 9.1
covered couch 9.1
male 8.8
natural 8.7
couch 8.7
rest 8.7
bathroom 8.7
erotic 8.6
resting 8.6
model 8.6
youth 8.5
floor 8.4
pillow 8.2
sensuality 8.2
water 8
interior 8
look 7.9
brunette 7.8
black 7.8
comfort 7.7
modern 7.7
comfortable 7.6
loving 7.6
casual 7.6
relaxed 7.5
sensual 7.3
litter 7.2
dress 7.2
soft 7.2

Google
created on 2022-01-08

Picture frame 95.7
Art 83.7
Rectangle 79.9
Baby 75.4
Window 74.8
Toddler 74.3
Vintage clothing 72.7
Visual arts 67.9
Painting 67.3
Happy 66.1
Illustration 64.3
Room 64.1
Stock photography 63.7
Child 61
Flash photography 60.9
Photo caption 60.5
Drawing 59
Monochrome photography 57.7
Still life photography 57.6
Chest 57.4

Microsoft
created on 2022-01-08

baby 96.8
indoor 95.4
toddler 93.5
text 81.7
human face 76.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Male, 99.8%
Surprised 90.7%
Calm 7.6%
Confused 0.6%
Fear 0.4%
Disgusted 0.2%
Sad 0.2%
Happy 0.2%
Angry 0.1%

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Cat 83%
Person 73.7%

Categories

Imagga

pets animals 98.2%
paintings art 1.1%

Captions

Microsoft
created on 2022-01-08

a cat lying on a bed 63.6%
a cat sleeping on top of a bed 50.8%
a cat sleeping on a bed 50.7%