Human Generated Data

Title

Untitled (twins)
Date

c. 1920
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.744

Human Generated Data

Title

Untitled (twins)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.744

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Baby 95.9
Human 95.9
Person 93.6
Person 92.5
Newborn 86.3
Face 84.8
Portrait 71.8
Photography 71.8
Photo 71.8
Clothing 67.6
Apparel 67.6
Toy 60
Finger 58.4
Dress 55.9
Pillow 55.7
Cushion 55.7

Clarifai
created on 2023-10-25

child 100
baby 99.9
son 99.9
portrait 99.2
sibling 99.1
family 99
little 98.6
innocence 98.5
cute 98
toddler 98
people 96.9
two 96.7
three 96.7
girl 96.4
infancy 96.2
sepia 96
toy 95.4
offspring 95
monochrome 94.9
precious 94

Imagga
created on 2022-01-08

child 100
baby 86.2
sibling 78.1
kid 56
childhood 50.3
little 48.7
toddler 47.9
cute 45.3
infant 41.6
son 37.8
boy 37.5
parent 35.2
happy 35.2
mother 34.8
happiness 33.8
family 32.1
portrait 31.1
fun 30
adorable 29.6
face 27.8
cheerful 27.7
joy 27.6
care 27.2
children 26.5
newborn 25.3
daughter 24.8
neonate 24.4
innocence 24.1
innocent 23.9
love 23.7
male 22.8
people 21.8
smiling 21.8
smile 21.4
father 20.4
offspring 19.9
play 19.9
sweet 19.8
eyes 19
kids 18.9
person 18.1
human 18
dad 17.7
expression 17.1
toy 15.7
playing 15.5
girls 15.5
youth 15.4
joyful 14.7
healthy 14.5
together 14.1
sitting 13.8
one 13.5
life 13.3
looking 12.8
pretty 11.9
two 11.9
blond 11.6
brother 11.5
funny 11
lifestyle 10.9
mom 10.7
attractive 10.5
playful 10.4
laughing 10.4
born 10
holding 9.9
studio 9.9
hand 9.9
new 9.7
togetherness 9.5
clean 9.2
health 9.1
close 8.6
skin 8.5
mouth 8.5
adult 8.4
lovely 8
women 7.9
look 7.9
hands 7.8
generation 7.7
closeup 7.4

Google
created on 2022-01-08

Nose 98.4
Face 98.3
Cheek 97.9
Hairstyle 95.1
Facial expression 93.2
Sleeve 87.2
Standing 86.4
Happy 85.3
Gesture 85.3
Iris 84.3
Style 83.8
Toddler 80.8
Art 80.8
Baby 80.4
Child 76.6
Monochrome 74.5
Baby & toddler clothing 74
Vintage clothing 71.5
Monochrome photography 70.9
Stock photography 63.5

Microsoft
created on 2022-01-08

baby 99.8
wall 99.5
person 99.4
indoor 99.1
child 98.5
sitting 94.7
human face 92.1
boy 79.9
infant 66.2
high 32.6
toddler 25.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 85.5%
Happy 88%
Calm 8.8%
Confused 1.8%
Disgusted 0.6%
Angry 0.3%
Surprised 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 0-3
Gender Female, 88.8%
Happy 69.1%
Calm 25.7%
Confused 1.7%
Disgusted 1.7%
Angry 0.6%
Surprised 0.5%
Sad 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 93.6%
Person 92.5%

Categories

Imagga

people portraits 97.2%
paintings art 1.5%
pets animals 1.3%

Text analysis

Amazon

SAINT
SAINT LOUIS
LOUIS
ARTIN
SCHWEIG
M ARTIN SCHWEIG
M

Google

MARTIN SCHW IE II G SAINT LOUIS
MARTIN
SCHW
IE
II
G
SAINT
LOUIS