Human Generated Data

Title

Untitled (young boy holding toy pig while seated on windowsill with baby sister)
Date

1930-1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10186

Human Generated Data

Title

Untitled (young boy holding toy pig while seated on windowsill with baby sister)

People

Artist: Martin Schweig, American 20th century

Date

1930-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.6
Human 98.6
Person 94.9
Clothing 89.8
Apparel 89.8
Door 69.7
Finger 69.5
Girl 60.1
Female 60.1
Baby 58.4
Blonde 58.3
Teen 58.3
Woman 58.3
Kid 58.3
Child 58.3
Hair 58.1
Poster 56.6
Advertisement 56.6

Imagga
created on 2022-01-22

child 67.9
kid 39
family 36.5
childhood 35.8
boy 33.9
happy 33.9
little 30.9
cute 30.2
brother 27.6
parent 27.2
sibling 26.6
people 26.2
children 25.5
mother 25.4
person 25
fun 24.7
baby 24.4
home 23.1
son 23.1
smile 22.8
portrait 22.7
male 21.5
happiness 21.2
love 20.5
cheerful 20.3
smiling 20.3
father 20.2
daughter 19.8
adorable 19.4
face 19.2
blond 19
kids 18.8
youth 18.7
together 17.5
play 17.2
playing 16.4
joy 15.9
girls 15.5
toddler 15.3
man 14.1
sitting 13.8
lifestyle 13.7
infant 13.5
expression 12.8
looking 12.8
casual 12.7
indoors 12.3
innocent 11.9
adult 11.7
dad 11.5
enjoying 11.4
two 11
indoor 11
leisure 10.8
holding 10.7
interior 10.6
offspring 10.6
one 10.5
outdoors 10.5
clothing 10.4
playful 10.4
enjoy 10.4
hold 10.2
park 9.9
pretty 9.8
mom 9.7
togetherness 9.4
grandfather 9.4
enjoyment 9.4
joyful 9.2
old 9.1
human 9
parenthood 8.8
plaything 8.7
stocking 8.5
black 8.4
attractive 8.4
house 8.4
life 8
youthful 7.8
standing 7.8
doll 7.8
color 7.8
gift 7.7
affection 7.7
outside 7.7
domestic 7.4
holiday 7.2
colorful 7.2
hair 7.1
lovely 7.1
shop 7.1

Google
created on 2022-01-22

Gesture 85.3
Style 83.8
Black-and-white 83
Toddler 76.6
Vintage clothing 73
Baby 72.1
Monochrome 71.3
Monochrome photography 71.2
Flash photography 71.2
Child 67.5
Room 67.1
Art 66.5
Photo caption 66.4
Sitting 64.5
Stock photography 63.8
Fun 60
Photographic paper 59.5
Portrait 58.7
Baby & toddler clothing 55
Retro style 54.3

Microsoft
created on 2022-01-22

person 99.3
baby 98.5
toddler 98.4
human face 97.1
clothing 96.8
window 94.9
indoor 88.9
text 87.9
boy 82.2
black 74
child 69.6
smile 67.2

Face analysis

Amazon

Google

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Sad 78.5%
Calm 13.3%
Angry 4.5%
Disgusted 1.8%
Confused 1%
Fear 0.3%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 4-12
Gender Female, 100%
Calm 99%
Sad 0.9%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a boy standing in front of a window 76.7%
a little boy standing in front of a window 68%
a little boy that is standing in front of a window 63.9%

Text analysis

Amazon

SAINT
PROOF
SAINT LOUIS
LOUIS
SCHWEIG
MARTIN SCHWEIG
MARTIN

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS