Human Generated Data

Title

Untitled (young girl sitting on desk smelling flower)
Date

1935-1955
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10209

Human Generated Data

Title

Untitled (young girl sitting on desk smelling flower)

People

Artist: Martin Schweig, American 20th century

Date

1935-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 97.4
Apparel 97.4
Person 95.2
Human 95.2
Skin 72.8
Female 71.2
Sitting 67.9
Shoe 66.7
Footwear 66.7
Girl 66.5
Finger 65.7
Dress 63
Portrait 62.3
Photography 62.3
Face 62.3
Photo 62.3
Kid 56.2
Child 56.2

Imagga
created on 2022-01-22

harmonica 82.5
free-reed instrument 66
wind instrument 50.6
child 49.3
portrait 35.6
musical instrument 34
kid 33.7
cute 29.5
happy 28.2
little 27.4
childhood 25.1
baby 24.8
face 24.2
people 24
person 22.7
boy 22.6
smile 22.1
smiling 21.7
adult 21.4
male 20.5
home 20
children 19.2
family 18.7
man 18.2
expression 17.9
happiness 17.3
eyes 17.2
pretty 16.8
one 16.4
toddler 16.3
love 15.8
fun 15.7
adorable 14.8
call 14.8
attractive 14.7
sitting 14.6
parent 14
playing 13.7
youth 13.6
joy 13.4
indoors 13.2
lifestyle 13
lady 13
hand 12.9
daughter 12.9
looking 12.8
casual 12.7
hair 12.7
infant 12.6
look 12.3
mother 12
sweet 11.9
son 11.6
couple 11.3
blond 11.3
human 11.3
play 10.4
grandma 10.3
skin 10.3
handsome 9.8
together 9.7
model 9.3
emotion 9.2
holding 9.1
old 9.1
cheerful 9
healthy 8.8
newborn 8.8
elderly 8.6
kids 8.5
mouth 8.5
senior 8.4
mature 8.4
phone 8.3
alone 8.2
girls 8.2
father 8.2
body 8
clothing 7.9
husband 7.6
wife 7.6
charming 7.6
innocent 7.6
enjoy 7.5
care 7.4
lips 7.4
funny 7.4
indoor 7.3
sexy 7.2

Google
created on 2022-01-22

Clothing 98.7
Cheek 97.9
Dress 86.8
Gesture 85.3
Flash photography 84.4
Happy 82.4
Toddler 78
Vintage clothing 76.4
Poster 71.1
Child 69.5
Shorts 68.1
Room 67.1
Monochrome photography 65.5
Sitting 64.9
Stock photography 64.4
Monochrome 63.2
Human leg 63.1
Portrait 59.3
Fun 58.4
Portrait photography 58.1

Microsoft
created on 2022-01-22

person 99.8
toddler 98.5
baby 97.6
girl 95.7
human face 95.7
clothing 90.8
little 90.4
child 89.1
text 88.9
black and white 56.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Surprised 75.3%
Disgusted 5.9%
Calm 5.4%
Fear 5.3%
Angry 2.6%
Sad 2.5%
Happy 1.6%
Confused 1.5%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.2%

Captions

Microsoft

a little girl posing for a photo 91.2%
a little girl posing for a picture 91.1%
a little girl holding a cell phone 65.6%

Text analysis

Amazon

PROOF
LOUIS
SAINT LOUIS
SAINT
MARTIN
MARTIN SCHWEIG
SCHWEIG
Hi
ogez

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS