Human Generated Data

Title

Untitled (album of two infants)
Date

c. 1930
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.676

Human Generated Data

Title

Untitled (album of two infants)

People

Artist: Martin Schweig, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-11

Person 99.1
Human 99.1
Person 98.3
Cushion 98.2
Couch 91.1
Furniture 91.1
Face 90.9
Baby 89.9
Car Seat 81.4
Sitting 69.6
People 67
Photography 65.2
Portrait 65.2
Photo 65.2
Kid 61.2
Child 61.2
Smile 60.2
Bush 59.2
Vegetation 59.2
Plant 59.2
Chair 59.2

Clarifai
created on 2019-11-11

child 100
people 99.7
baby 99.6
son 99.6
two 99.3
portrait 98.8
offspring 98.5
family 98.5
seat 97.9
sibling 96.4
three 96.3
girl 95.9
group 95.6
wear 93
furniture 92.1
love 92
one 91.6
facial expression 91.3
toddler 91.2
adult 90.3

Imagga
created on 2019-11-11

child 90.7
father 73.6
parent 67.7
dad 59.9
family 59.7
mother 53.7
son 52.9
sibling 51.9
baby 42.5
male 41.6
love 40.3
kid 38.2
cute 36.6
childhood 35.9
boy 35.7
children 35.6
happy 35.1
daughter 32.4
happiness 32.2
little 30.1
home 29.6
brother 28.1
together 26.3
fun 24.7
people 24.6
smiling 23.9
joy 23.4
infant 22.2
adorable 22.2
portrait 22
cheerful 22
kids 20.7
face 20.6
offspring 20.2
man 20.2
mom 19.4
toddler 19.1
holding 18.2
adult 18.1
smile 17.8
care 17.3
husband 17.2
casual 17
parenthood 16.6
lifestyle 15.9
indoors 15.8
kin 15.7
newborn 15.6
parents 14.7
sitting 14.6
affectionate 14.5
loving 14.3
togetherness 14.2
couple 14
expression 13.7
youth 13.6
indoor 12.8
boys 12.6
innocence 12.5
black 12
men 12
playing 11.9
generations 11.9
leisure 11.6
hug 11.6
30s 11.6
studio 11.4
living 11.4
laughing 11.4
joyful 11
two 11
life 11
girls 11
hugging 10.7
mid adult 10.6
wife 10.4
looking 10.4
color 10
fatherhood 9.9
human 9.8
innocent 9.7
affection 9.7
diversity 9.6
person 9.5
sweet 9.5
enjoyment 9.4
house 9.2
attractive 9.1
one 9
cuddle 8.9
mum 8.8
sister 8.8
bonding 8.8
four 8.6
play 8.6
enjoying 8.5
hand 8.4
hold 8.3
clothing 8.1
women 7.9
mommy 7.9
living room 7.8
embracing 7.8
motherhood 7.8
40s 7.8
eyes 7.8
couch 7.7
looking camera 7.7
laugh 7.7
arms 7.7
race 7.7
head 7.6
enjoy 7.5
toy 7.4
room 7.3
group 7.3
domestic 7.2
blond 7.2

Google
created on 2019-11-11

Photograph 96
People 93.1
Child 90.6
Snapshot 84.1
Photographic paper 76.3
Picture frame 67.8
Room 65.7
Sibling 64.2
Smile 64.1
Family 62.7
Photography 62.4
Baby 52.2
Album 51.4
Square 51.2
Mother 50.8

Microsoft
created on 2019-11-11

toddler 98.9
person 98.2
human face 97.5
sitting 95.4
child 95.1
indoor 94.2
boy 91.5
clothing 90.8
smile 85.3
baby 72.3
text 61.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 95.8%
Surprised 0%
Fear 0%
Angry 0%
Disgusted 0%
Happy 100%
Confused 0%
Calm 0%
Sad 0%

AWS Rekognition

Age 0-3
Gender Female, 50.3%
Angry 0.1%
Disgusted 0%
Surprised 0.1%
Happy 99.3%
Sad 0%
Fear 0%
Confused 0.1%
Calm 0.4%

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Couch 91.1%

Captions

Microsoft

a vintage photo of a baby 85.2%
a vintage photo of a baby sitting in a chair 79.3%
a vintage photo of a small child sitting on a train 54.9%

Text analysis

Amazon

MARTIN
MARTIN SCHWEIG
SCHWEIG
SAINT
SAINT LOUIS
LOUIS

Google

MARTIN SCHWEIC SAINT LOUIS
MARTIN
SCHWEIC
SAINT
LOUIS