Human Generated Data

Title

Untitled (young boy holding toy pig while seated on windowsill with baby sister)

Date

1930-1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10186

Human Generated Data

Title

Untitled (young boy holding toy pig while seated on windowsill with baby sister)

People

Artist: Martin Schweig, American 20th century

Date

1930-1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10186

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.6
Human 98.6
Person 94.9
Clothing 89.8
Apparel 89.8
Door 69.7
Finger 69.5
Girl 60.1
Female 60.1
Baby 58.4
Blonde 58.3
Teen 58.3
Woman 58.3
Kid 58.3
Child 58.3
Hair 58.1
Poster 56.6
Advertisement 56.6

Clarifai
created on 2023-10-26

child 99.8
monochrome 99.7
people 99.7
family 97.7
two 97.2
son 96.6
nostalgia 96.5
indoors 95.6
retro 95.1
portrait 94.2
sepia 93.9
baby 92.1
sibling 91.1
woman 89.7
wear 87.1
three 86.8
offspring 85.3
sit 83.7
documentary 81.2
facial expression 80.2

Imagga
created on 2022-01-22

child 67.9
kid 39
family 36.5
childhood 35.8
boy 33.9
happy 33.9
little 30.9
cute 30.2
brother 27.6
parent 27.2
sibling 26.6
people 26.2
children 25.5
mother 25.4
person 25
fun 24.7
baby 24.4
home 23.1
son 23.1
smile 22.8
portrait 22.7
male 21.5
happiness 21.2
love 20.5
cheerful 20.3
smiling 20.3
father 20.2
daughter 19.8
adorable 19.4
face 19.2
blond 19
kids 18.8
youth 18.7
together 17.5
play 17.2
playing 16.4
joy 15.9
girls 15.5
toddler 15.3
man 14.1
sitting 13.8
lifestyle 13.7
infant 13.5
expression 12.8
looking 12.8
casual 12.7
indoors 12.3
innocent 11.9
adult 11.7
dad 11.5
enjoying 11.4
two 11
indoor 11
leisure 10.8
holding 10.7
interior 10.6
offspring 10.6
one 10.5
outdoors 10.5
clothing 10.4
playful 10.4
enjoy 10.4
hold 10.2
park 9.9
pretty 9.8
mom 9.7
togetherness 9.4
grandfather 9.4
enjoyment 9.4
joyful 9.2
old 9.1
human 9
parenthood 8.8
plaything 8.7
stocking 8.5
black 8.4
attractive 8.4
house 8.4
life 8
youthful 7.8
standing 7.8
doll 7.8
color 7.8
gift 7.7
affection 7.7
outside 7.7
domestic 7.4
holiday 7.2
colorful 7.2
hair 7.1
lovely 7.1
shop 7.1

Microsoft
created on 2022-01-22

person 99.3
baby 98.5
toddler 98.4
human face 97.1
clothing 96.8
window 94.9
indoor 88.9
text 87.9
boy 82.2
black 74
child 69.6
smile 67.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Sad 78.5%
Calm 13.3%
Angry 4.5%
Disgusted 1.8%
Confused 1%
Fear 0.3%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 99%
Sad 0.9%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Categories

Imagga

people portraits 96.6%
paintings art 3.1%

Text analysis

Amazon

SAINT
PROOF
SAINT LOUIS
LOUIS
SCHWEIG
MARTIN SCHWEIG
MARTIN

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS