Human Generated Data

Title

Untitled (portrait of woman with baby)
Date

c. 1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1416

Human Generated Data

Title

Untitled (portrait of woman with baby)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98
Person 97.1
Face 96
Baby 94
Newborn 94
Person 92.4
Female 89
Apparel 77.9
Clothing 77.9
Teen 77.6
Photography 75.7
Portrait 75.7
Photo 75.7
Woman 74.4
Girl 71.5
Drawing 71.2
Art 71.2
People 65.6
Kid 64.4
Child 64.4
Sketch 60.5
Blonde 59.7
Sleeve 59.6

Imagga
created on 2022-01-22

mother 62.3
daughter 55.9
parent 53.2
child 47.2
family 44.5
home 36.7
happy 34.5
father 32.8
people 30.7
male 28.8
kid 27.5
adult 25.9
smiling 25.3
portrait 24.6
happiness 24.3
smile 24.3
baby 23.9
love 23.7
man 23.5
dad 22.6
childhood 22.4
nurse 21.7
son 20.8
grandma 20.7
fun 19.5
together 19.3
casual 18.7
person 17.8
little 17.7
boy 16.5
cute 16.5
couple 15.7
lifestyle 15.2
wife 15.2
clothing 15.1
joy 15
face 14.9
holding 14.9
husband 14.3
interior 14.2
attractive 14
girls 13.7
looking 13.6
two 13.6
pajama 13.2
care 13.2
expression 12.8
children 12.8
pretty 12.6
toddler 12.4
indoors 12.3
adorable 12
blond 11.9
women 11.9
newborn 11.7
infant 11.6
togetherness 11.3
brunette 11.3
room 11
parents 10.8
brother 10.7
mom 10.7
sitting 10.3
relationship 10.3
life 10.3
nightwear 10.1
hand 9.9
cheerful 9.8
senior 9.4
youth 9.4
mature 9.3
house 9.2
old 9.1
lady 8.9
sofa 8.6
pink 8.4
leisure 8.3
patient 8.1
kitchen 8.1
handsome 8
motherhood 7.8
two people 7.8
generation 7.7
females 7.6
sit 7.6
laughing 7.6
stethoscope 7.6
doctor 7.5
human 7.5
one 7.5
sibling 7.4
emotion 7.4
inside 7.4
playing 7.3
black 7.2
hair 7.1
medical 7.1

Google
created on 2022-01-22

Photograph 94.2
Iris 84.4
Baby 82.6
Toddler 78.6
People 78
Happy 77.3
Sleeve 76.3
Vintage clothing 74.3
Baby & toddler clothing 70.9
Room 64.8
Child 63.7
Stock photography 63.2
Portrait 61
Classic 60
Art 57.3
Portrait photography 56.8
Retro style 55.4
Monochrome photography 54.6
Family 54.1
Smile 52.7

Microsoft
created on 2022-01-22

person 99.9
wall 99.9
indoor 97.6
baby 97.3
human face 97.2
toddler 93
clothing 86.7
text 77.2
smile 75.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 99.2%
Surprised 0.2%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Female, 81.8%
Calm 86.2%
Surprised 11.6%
Confused 0.8%
Disgusted 0.5%
Happy 0.3%
Sad 0.2%
Fear 0.2%
Angry 0.2%

Microsoft Cognitive Services

Age 0
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a person holding a baby 81.5%
a close up of a person holding a baby 70.9%
a person holding a baby that is looking at the camera 62.4%

Text analysis

Amazon

MARTIN
TEN
AND
DAYS
WITHIN TEN DAYS
BE
WITHIN
STUDIO
RETURNED
AND SHOULD BE RETURNED
SHOULD
WITH
MARTIN SCHWEIG STUDIO
SCHWEIG
Inio
ORTHE
AIR

Google

MARTIN
DAYS
呈
THC
SCWEIG
TEN
WITH
呈 OF THC MARTIN SCWEIG STUDIO AND SHOULD BE RETURNED WITHIN TEN DAYS WITH
SHOULD
RETURNED
STUDIO
AND
BE
OF
WITHIN