Human Generated Data

Title

Untitled (girl and infant)

Date

c. 1920

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.732

Human Generated Data

Title

Untitled (girl and infant)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98
Person 98
Person 94.1
Newborn 93.5
Baby 93.5
Apparel 90.8
Clothing 90.8
Face 89.6
Furniture 89.6
Photo 73.4
Portrait 73.4
Photography 73.4
People 71
Female 70.1
Sitting 68.7
Art 67.9
Painting 67.9
Wood 66.7
Girl 59.2
Smile 58.4
Costume 57
Floor 56.6

Imagga
created on 2022-01-08

child 44.9
mother 39.7
parent 34.9
family 32.9
people 31.8
home 31.1
happy 26.3
man 26.2
male 25.8
portrait 24.6
father 24.6
adult 23.9
love 23.7
person 23.3
son 21.6
happiness 21.2
baby 20.6
couple 20
daughter 19.6
smiling 18.8
room 18.7
kid 18.6
sitting 18
smile 17.8
face 17.8
interior 16.8
grandma 16.7
indoors 16.7
together 16.7
sofa 16.4
casual 16.1
boy 15.7
children 15.5
loving 15.3
pretty 14.7
cute 14.4
dad 13.7
bed 13.4
attractive 13.3
old 13.2
lifestyle 13
cheerful 13
clothing 12.1
life 11.8
dress 11.8
joy 11.7
childhood 11.7
couch 11.6
infant 11.6
holding 11.6
care 11.5
brother 11.5
husband 11.5
domestic 11.3
looking 11.2
women 11.1
human 10.5
relationship 10.3
indoor 10
relaxing 10
affectionate 9.7
cradle 9.7
sexy 9.6
30s 9.6
comfortable 9.6
sibling 9.5
hair 9.5
wife 9.5
nurse 9.3
kin 9.3
baby bed 9.2
house 9.2
furniture 9.1
fun 9
little 8.8
living room 8.8
half length 8.8
newborn 8.8
affection 8.7
married 8.6
kids 8.5
girls 8.2
hospital 8.2
aged 8.2
lady 8.1
antique 8.1
caring 7.9
parents 7.8
hugging 7.8
sleeping 7.8
model 7.8
two people 7.8
grandfather 7.8
doll 7.8
expression 7.7
elderly 7.7
health 7.6
hand 7.6
togetherness 7.6
plaything 7.5
senior 7.5
one 7.5
mature 7.4
style 7.4
camera 7.4
color 7.2
offspring 7

Google
created on 2022-01-08

Clothing 98.6
Facial expression 93.3
Dress 85.2
Art 79.4
Vintage clothing 79.3
Toddler 78.4
Picture frame 77.3
Child 74.6
Baby 71.6
Room 71.3
Monochrome 70.3
Sitting 69.6
Classic 69.4
Stock photography 64.5
Antique 61.2
Lap 60.1
Retro style 58.4
Photographic paper 57.1
Visual arts 56.2
Chair 55.8

Microsoft
created on 2022-01-08

baby 99.6
toddler 99.4
human face 98.7
wall 97.8
clothing 97.8
person 96.4
window 93.7
indoor 90.1
smile 87.7
text 87.1
child 82.9
boy 68.9
old 51.8
picture frame 11

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 80.5%
Happy 99.9%
Calm 0.1%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 100%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Painting 67.9%

Captions

Microsoft

an old photo of a baby 88.5%
a person holding a baby 84.1%
a baby posing for the camera 84%