Human Generated Data

Title

Untitled (double studio portrait of young girl posed sitting with baby sister)
Date

1937
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10213

Human Generated Data

Title

Untitled (double studio portrait of young girl posed sitting with baby sister)

People

Artist: Martin Schweig, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.7
Dress 99.7
Apparel 99.7
Face 99.3
Human 99.3
Smile 98.3
Female 97.6
Person 97.1
Baby 94.7
Teen 90.7
Woman 87.8
Blonde 87.7
Kid 87.7
Girl 87.7
Child 87.7
Person 84.1
Portrait 79.9
Photography 79.9
Photo 79.9
People 65.1
Newborn 64.4
Furniture 59.6
Chair 56.5
Sitting 56.4
Floor 55.9

Imagga
created on 2022-01-22

mother 100
parent 90.1
child 78.8
family 54.3
kid 43.5
father 36.7
childhood 35.9
happy 35.1
daughter 32.4
children 31
male 29.8
baby 29.7
son 29.1
happiness 29
cute 28.7
love 27.7
people 26.8
little 26.5
home 26.4
fun 26.2
dad 25.7
boy 25.2
smile 23.5
cheerful 22.8
joy 22.6
together 21.9
portrait 21.4
smiling 21
man 20.2
girls 20.1
toddler 19.1
adult 18.8
face 18.5
adorable 18.5
playing 17.3
kids 17
mom 16.5
husband 16.2
indoors 15.8
sitting 15.5
youth 15.3
casual 15.3
lifestyle 15.2
infant 14.5
play 13.8
expression 13.7
wife 13.3
care 13.2
couple 13.1
room 12.8
two 12.7
life 12.5
holding 12.4
togetherness 12.3
offspring 12.1
parenthood 11.7
interior 11.5
toy 11.1
doll 10.7
newborn 10.7
brother 10.6
old 10.5
sit 10.4
women 10.3
blond 10.1
domestic 10
leisure 10
sibling 9.9
grandma 9.8
one 9.7
person 9.7
color 9.5
laughing 9.5
house 9.2
joyful 9.2
indoor 9.1
dress 9
black 9
parents 8.8
motherhood 8.8
innocence 8.7
loving 8.6
living 8.5
enjoying 8.5
clothing 8.5
attractive 8.4
studio 8.4
healthy 8.2
plaything 8.2
innocent 8
looking 8
sweet 7.9
grandmother 7.8
couch 7.7
human 7.5
relaxing 7.3
group 7.3
darling 7.1
pretty 7

Google
created on 2022-01-22

Face 98.4
Hair 98.3
Head 97.3
Smile 96.5
Photograph 94.2
White 92.2
Dress 87.8
Happy 83.8
Flash photography 80.1
One-piece garment 79.8
Picture frame 79.7
Toddler 79.5
Baby 75.5
Monochrome 74.7
Vintage clothing 74.5
Snapshot 74.3
Art 72.7
Day dress 72.5
Monochrome photography 71.3
Event 68.8

Microsoft
created on 2022-01-22

wall 99.7
baby 98.8
person 98.5
toddler 98.5
human face 98.3
clothing 95.1
text 93.8
indoor 92.6
child 92.3
smile 90.6
posing 63.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 86.5%
Happy 61.8%
Calm 24.1%
Sad 6.1%
Confused 2.8%
Fear 1.8%
Angry 1.3%
Surprised 1.1%
Disgusted 1%

AWS Rekognition

Age 0-3
Gender Female, 99.7%
Happy 98.5%
Surprised 0.7%
Calm 0.4%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Fear 0%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a vintage photo of a little girl posing for a picture 93.1%
a little girl posing for a photo 93%
a vintage photo of a little girl posing for a photo 91.3%

Text analysis

Amazon

LOUIS
PROOF
SCHWEIG
SAINT LOUIS
MARTIN SCHWEIG
MARTIN
SAINT

Google

PROOF
SCHWEIG
LOUIS
PROOF MARTIN SCHWEIG SAINT LOUIS
MARTIN
SAINT