Human Generated Data

Title

Untitled (proof, woman with dog)
Date

1950s
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.831

Human Generated Data

Title

Untitled (proof, woman with dog)

People

Artist: Martin Schweig, American 20th century

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.9
Person 98.9
Text 97.2
Furniture 94.9
Pillow 85.2
Cushion 85.2
Animal 84.2
Canine 84.2
Mammal 84.2
Pet 75.3
Handwriting 65.2
White Board 63.4
Dog 58.8
Puppy 58.8

Imagga
created on 2022-01-08

west highland white terrier 100
terrier 100
hunting dog 93.5
dog 84.4
canine 38.6
domestic animal 32.6
cute 27.3
child 26.7
pet 25.7
happy 24.4
portrait 23.3
family 22.2
love 22.1
adorable 18.5
kid 17.7
fur 17.6
people 17.3
person 17
little 16.8
face 16.3
pooch 15.7
pretty 15.4
smiling 15.2
home 15.2
smile 15
happiness 14.9
puppy 14.7
holding 14
darling 14
domestic 13.6
childhood 13.4
mother 13.3
attractive 13.3
adult 12.9
cat 12.3
couple 12.2
looking 12
children 11.8
male 11.3
boy 11.3
fun 11.2
sitting 11.2
head 10.9
care 10.7
lady 10.5
casual 10.2
indoors 9.7
together 9.6
pets 9.6
lifestyle 9.4
expression 9.4
skin 9.3
studio 9.1
cheerful 8.9
father 8.9
interior 8.8
hair 8.7
couch 8.7
sweet 8.7
toddler 8.6
baby 8.4
black 8.4
old 8.4
toy 8.3
park 8.2
one 8.2
blond 8.1
parent 8.1
women 7.9
look 7.9
brunette 7.8
life 7.8
eyes 7.7
loving 7.6
two 7.6
friend 7.6
enjoying 7.6
friends 7.5
human 7.5
senior 7.5
leisure 7.5
outdoors 7.5
animals 7.4
man 7.4
playing 7.3
day 7.1

Google
created on 2022-01-08

Dog 95.4
Photograph 94.2
Dog breed 92.1
Carnivore 86.6
Smile 83.9
Handwriting 83.1
Companion dog 82.6
Fawn 81.6
Toy dog 76.7
Snapshot 74.3
Sporting Group 72.4
Happy 71.5
Vintage clothing 71.2
Photo caption 70.4
Canidae 68
Fur 67
Pattern 66.8
Sitting 63.6
Stock photography 63.3
Puppy love 62.8

Microsoft
created on 2022-01-08

text 99.9
carnivore 97.2
wall 96.2
person 94.8
sitting 94.6
dog 90.3
indoor 89.5
animal 88.5
puppy 60

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Female, 100%
Happy 98.1%
Surprised 0.5%
Calm 0.4%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a person holding a dog 90%
a person sitting in a chair holding a dog 88.3%
a person sitting next to a dog 84.3%

Text analysis

Amazon

PROOF
hair
MARTIN
LOUIS
SAINT LOUIS
SAINT
MARTIN SCHWEIG
sides
SCHWEIG
of
cut
fill
cut down sides
down
of fase
fill ui hair
hughlight hair
fase
stoo
hughlight
ui

Google

Cut
dawn
Cut dawn idis ofare hughelight hair too noreimede PROOF MARTIN SCHWEIG SAINT L OUIS lill ni hair
noreimede
idis
ofare
hughelight
hair
SCHWEIG
L
ni
MARTIN
too
PROOF
SAINT
OUIS
lill