Human Generated Data

Title

Untitled (young woman posed sitting on floor with dog and young boy)
Date

1938
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10220

Human Generated Data

Title

Untitled (young woman posed sitting on floor with dog and young boy)

People

Artist: Martin Schweig, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.1
Human 99.1
Hound 97.5
Canine 97.5
Pet 97.5
Animal 97.5
Mammal 97.5
Person 95.7
Dog 93.7
Chair 81.7
Furniture 81.7
Terrier 68
Afghan Hound 67.4
Kid 58
Child 58
Shoe 57.2
Clothing 57.2
Footwear 57.2
Apparel 57.2

Imagga
created on 2022-01-22

dog 100
shepherd dog 85.9
canine 69.9
terrier 51.5
hunting dog 46.7
pet 45.9
domestic animal 40.9
cute 35.1
puppy 32
hound 27.7
portrait 27.2
happy 21.3
fun 20.9
friend 20.9
domestic 20.8
breed 20.3
adorable 18.5
family 17.8
home 16.7
people 16.7
child 15.8
fur 15.8
love 15.8
together 14.9
pedigree 14.6
hair 14.3
pup 13.8
doggy 13.7
purebred 13.6
smile 13.5
male 13.5
pets 13.4
little 13.2
old 12.5
person 12.4
senior 12.2
face 12.1
lifestyle 11.6
funny 11
two 11
happiness 11
head 10.9
retired 10.7
kid 10.6
friendship 10.3
expression 10.2
mother 10.2
animals 10.2
smiling 10.1
man 10.1
studio 9.9
retriever 9.9
looking 9.6
fluffy 9.6
sweet 9.5
play 9.5
eyes 9.5
playing 9.1
cheerful 8.9
grandmother 8.8
hairy 8.8
look 8.8
grass 8.7
loving 8.6
blond 8.1
childhood 8.1
pedigreed 7.8
couple 7.8
tongue 7.8
adult 7.8
sitting 7.7
furry 7.7
elderly 7.7
nose 7.6
relaxed 7.5
baby 7.5
leisure 7.5
close 7.4
care 7.4
active 7.2
indoors 7

Google
created on 2022-01-22

Hairstyle 95.1
Dog 94.4
Dog breed 84.9
Carnivore 82.3
Companion dog 80.4
Snapshot 74.3
Vintage clothing 72.7
Child 67.2
Sitting 66.8
Room 66.8
Stock photography 64.5
Classic 63.8
Photo caption 63.8
Toy dog 63.5
Fur 63.3
Canidae 60.7
Monochrome photography 59.1
Art 58.4
Toddler 57
Monochrome 56.5

Microsoft
created on 2022-01-22

wall 99.6
person 97.2
text 96.7
baby 95.8
toddler 94.9
human face 94.1
indoor 93.2
clothing 87.7
smile 84.7
child 72.2
boy 56.5
posing 40.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 94.3%
Calm 3%
Confused 1%
Surprised 0.6%
Angry 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 2-8
Gender Male, 100%
Happy 90.6%
Calm 2.9%
Confused 2.6%
Sad 1.4%
Surprised 0.9%
Disgusted 0.6%
Angry 0.5%
Fear 0.5%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Dog 93.7%
Shoe 57.2%

Captions

Microsoft

a person posing for the camera 95.8%
a girl posing for a photo 87.6%
a person sitting posing for the camera 87.5%

Text analysis

Amazon

PROOF
MARTIN
MARTIN SCHWEIG
SAINT
SAINT LOUIS
LOUIS
SCHWEIG

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS