Human Generated Data

Title

Untitled (woman next to baby)
Date

c. 1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1428

Human Generated Data

Title

Untitled (woman next to baby)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.8
Person 99.8
Clothing 98.6
Apparel 98.6
Newborn 97.8
Baby 97.8
Person 91.6
Furniture 91.3
Face 87
Hat 69.3
Photography 65.3
Photo 65.3
Portrait 65.3
Bonnet 65.1
Cradle 55.6

Imagga
created on 2022-01-22

mother 84.6
parent 74.9
child 72.3
kid 36.3
family 35.6
childhood 34
happy 33.2
cute 30.1
little 27.4
people 27.3
children 26.4
happiness 25.9
boy 25.2
portrait 24.6
fun 24
son 23.7
smile 23.5
daughter 21.3
father 21.2
toddler 21
male 20.9
home 20.7
baby 20.1
dad 17.5
love 17.4
playing 17.3
together 16.7
smiling 16.6
casual 16.1
joy 15.9
cheerful 15.4
lifestyle 15.2
kids 15.1
adult 14.9
hat 14.6
person 14.1
play 13.8
girls 13.7
face 13.5
youth 12.8
dress 12.7
park 12.4
life 12.3
looking 12
attractive 11.9
women 11.9
two 11.9
clothing 11.7
man 11.4
adorable 11.1
indoors 10.5
sweet 10.3
blond 9.9
pretty 9.8
human 9.7
summer 9.6
leisure 9.1
old 9.1
two people 8.8
hair 8.7
grass 8.7
infant 8.7
playful 8.5
togetherness 8.5
room 8.4
toy 8.3
joyful 8.3
bonnet 8.2
book 8.2
outdoors 8.2
look 7.9
couple 7.8
sister 7.8
color 7.8
innocent 7.8
eyes 7.7
sitting 7.7
generation 7.7
expression 7.7
outdoor 7.6
loving 7.6
laughing 7.6
fashion 7.5
senior 7.5
relationship 7.5
holding 7.4
care 7.4
kin 7.1
work 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Human 90
Style 83.9
Headgear 81.2
Smile 80.5
Adaptation 79.3
Baby 78.2
People 77.8
Vintage clothing 76
Happy 75.6
Toddler 74.2
Monochrome photography 74.1
Monochrome 73.6
Child 70.2
Art 69.6
Headpiece 69
Classic 68.4
Room 67.6
Event 67.5
Hair accessory 64.1

Microsoft
created on 2022-01-22

wall 98.5
human face 97.6
baby 97.5
text 97.4
person 94.7
toddler 93.1
indoor 90.6
clothing 88.8
smile 58.8
child 57.9
old 47.6
posing 36.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Female, 99.8%
Calm 98.8%
Confused 0.4%
Happy 0.2%
Surprised 0.2%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 100%
Happy 98.2%
Surprised 0.8%
Calm 0.4%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a woman holding a baby 72.1%
a girl posing for a photo 72%
an old photo of a woman 71.9%

Text analysis

Amazon

Darker
eyes
toi
view
glance

Google

Darlker
Darlker