Human Generated Data

Title

Untitled (studio portrait of woman with young girl in matching dresses)

Date

1943

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10177

Human Generated Data

Title

Untitled (studio portrait of woman with young girl in matching dresses)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 96.6
Apparel 96.5
Dress 96.5
Clothing 96.5
Person 94.6
Female 94
Person 92.6
Face 87.9
People 84.1
Girl 81.5
Teen 76.8
Woman 73.6
Plant 71.5
Child 69.3
Kid 69.3
Portrait 68.8
Photo 68.8
Photography 68.8
Flower 66.3
Blossom 66.3
Blonde 61.6
Flower Arrangement 60.1
Advertisement 57.9
Gown 57.8
Robe 57.8
Evening Dress 57.8
Fashion 57.8
Finger 56.4
Poster 55.4

Imagga
created on 2022-01-22

mother 91
parent 77.1
family 59.7
child 59.4
daughter 55.7
love 41.9
happy 40.2
happiness 33
kid 32.8
home 32
father 30.9
together 30.7
sibling 29.5
male 28.9
people 27.9
smiling 26.8
boy 26.1
portrait 25.3
smile 25
couple 24.4
adult 23.3
children 22.8
cute 22.3
dad 22.2
baby 22
fun 21.7
childhood 21.5
two 21.2
man 20.9
brother 20
cheerful 19.5
casual 19.5
little 19.5
kids 18.9
indoors 18.5
lifestyle 18.1
son 17.7
girls 17.3
face 17.1
loving 16.2
joy 15.9
women 15.8
mom 15.5
youth 15.4
kin 14.6
sitting 14.6
husband 14.3
relationship 14.1
togetherness 13.2
adorable 12.9
parenthood 12.7
attractive 12.6
life 12.5
generation 12.5
holding 12.4
laughing 12.3
friends 12.2
men 12
room 11.9
old 11.9
grandmother 11.8
parents 11.7
affection 11.6
enjoying 11.4
friendship 11.3
indoor 11
dress 10.9
hug 10.7
affectionate 10.7
interior 10.6
infant 10.6
toddler 10.5
pretty 10.5
brunette 10.5
wife 10.4
mature 10.2
domestic 10.2
leisure 10
laugh 9.6
living 9.5
play 9.5
person 9.5
color 9.5
expression 9.4
house 9.2
playing 9.1
cuddle 8.9
embracing 8.8
motherhood 8.8
bonding 8.8
day 8.6
teen 8.3
joyful 8.3
care 8.2
teenager 8.2
lady 8.1
group 8.1
looking 8
generations 7.9
hugging 7.8
two people 7.8
boys 7.8
couch 7.7
married 7.7
studio 7.6
senior 7.5
aged 7.2
handsome 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 99.5
wall 99.3
indoor 98.9
human face 98.2
clothing 95.3
girl 93.6
smile 92.4
toddler 92.2
baby 91.9
text 85.7
dress 80.6
standing 75.9
child 73.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 94.4%
Happy 99.3%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Calm 0.1%
Sad 0%

AWS Rekognition

Age 0-6
Gender Female, 99.6%
Confused 77%
Surprised 10.7%
Calm 7.2%
Happy 3%
Angry 0.8%
Sad 0.5%
Fear 0.5%
Disgusted 0.3%

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.6%

Captions

Microsoft

a little girl posing for a photo 93.6%
a little girl posing for a picture 93.5%
a little girl standing in front of a window 87.3%

Text analysis

Amazon

STUDIO
MARTIN
IS
AND
THIS
PROOF
DAYS
WITHIN
WITHIN TEN DAYS
SHOULD
MARTIN SCHWEIG STUDIO
TEN
THE
THIS PROOF IS THE PROBERTY
SCHWEIG
PROBERTY
AND SHOULD DE RETURNED
OF THE
RETURNED
DE

Google

THIS
IS
OF
THE
BE
AND
SHOULD
WITHIN
MARTIN
THIS PROOF IS TE PROBERTY OF THE MARTIN SCHWNG STUDIO, AND SHOULD BE BETURNED WITHIN TEN DAYS
PROBERTY
SCHWNG
STUDIO,
TEN
DAYS
PROOF
TE
BETURNED