Human Generated Data

Title

Untitled (twins)

Date

c. 1920

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.744

Human Generated Data

Title

Untitled (twins)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Baby 95.9
Human 95.9
Person 93.6
Person 92.5
Newborn 86.3
Face 84.8
Photo 71.8
Portrait 71.8
Photography 71.8
Apparel 67.6
Clothing 67.6
Toy 60
Finger 58.4
Dress 55.9
Pillow 55.7
Cushion 55.7

Imagga
created on 2022-01-08

child 100
baby 86.2
sibling 78.1
kid 56
childhood 50.3
little 48.7
toddler 47.9
cute 45.3
infant 41.6
son 37.8
boy 37.5
parent 35.2
happy 35.2
mother 34.8
happiness 33.8
family 32.1
portrait 31.1
fun 30
adorable 29.6
face 27.8
cheerful 27.7
joy 27.6
care 27.2
children 26.5
newborn 25.3
daughter 24.8
neonate 24.4
innocence 24.1
innocent 23.9
love 23.7
male 22.8
people 21.8
smiling 21.8
smile 21.4
father 20.4
offspring 19.9
play 19.9
sweet 19.8
eyes 19
kids 18.9
person 18.1
human 18
dad 17.7
expression 17.1
toy 15.7
playing 15.5
girls 15.5
youth 15.4
joyful 14.7
healthy 14.5
together 14.1
sitting 13.8
one 13.5
life 13.3
looking 12.8
pretty 11.9
two 11.9
blond 11.6
brother 11.5
funny 11
lifestyle 10.9
mom 10.7
attractive 10.5
playful 10.4
laughing 10.4
born 10
holding 9.9
studio 9.9
hand 9.9
new 9.7
togetherness 9.5
clean 9.2
health 9.1
close 8.6
skin 8.5
mouth 8.5
adult 8.4
lovely 8
women 7.9
look 7.9
hands 7.8
generation 7.7
closeup 7.4

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

baby 99.8
wall 99.5
person 99.4
indoor 99.1
child 98.5
sitting 94.7
human face 92.1
boy 79.9
infant 66.2
high 32.6
toddler 25.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 85.5%
Happy 88%
Calm 8.8%
Confused 1.8%
Disgusted 0.6%
Angry 0.3%
Surprised 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 88.8%
Happy 69.1%
Calm 25.7%
Confused 1.7%
Disgusted 1.7%
Angry 0.6%
Surprised 0.5%
Sad 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.6%

Captions

Microsoft

a vintage photo of a baby 95.7%
a vintage photo of a baby holding a stuffed animal 81.1%
a vintage photo of a person holding a baby 81%

Text analysis

Amazon

SAINT
SAINT LOUIS
LOUIS
ARTIN
SCHWEIG
M ARTIN SCHWEIG
M

Google

MARTIN
SCHW
IE
II
LOUIS
G
SAINT
MARTIN SCHW IE II G SAINT LOUIS