Human Generated Data

Title

Untitled (studio portrait of blond woman with young daughter in white dress)

Date

1953

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10175

Human Generated Data

Title

Untitled (studio portrait of blond woman with young daughter in white dress)

People

Artist: Martin Schweig, American 20th century

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98
Person 98
Person 93
Face 87.5
Female 82.2
Clothing 81.3
Apparel 81.3
Text 74.8
Blonde 74.7
Kid 74.7
Teen 74.7
Girl 74.7
Woman 74.7
Child 74.7
People 72.1
Linen 68.5
Home Decor 68.5
Photography 63.6
Portrait 63.6
Photo 63.6

Imagga
created on 2022-01-22

child 49.4
family 48.1
kin 43.4
happy 38.3
male 37.1
sibling 36.2
mother 36.1
together 36
home 35.1
people 34.1
parent 32.5
daughter 32.4
father 32.3
smiling 30.4
man 28.3
person 26.4
senior 26.3
portrait 25.3
happiness 24.3
kid 24
love 23.7
couple 23.5
smile 23.5
childhood 23.3
lifestyle 22.4
adult 22.1
fun 21.7
boy 20.9
two 20.3
mature 19.5
son 19.5
little 19.4
baby 19.3
children 19.2
elderly 18.2
indoors 17.6
dad 17.4
blond 17.3
husband 17.2
joy 15.9
cute 15.8
casual 15.3
leisure 15
cheerful 14.6
married 14.4
wife 14.2
sitting 13.8
grandmother 13.7
playing 13.7
toddler 13.4
bow tie 13.4
grandfather 13.1
necktie 12.6
room 12.3
group 12.1
men 12
women 11.9
school 11.7
retired 11.6
togetherness 11.3
old 11.2
grandma 10.9
color 10.6
retirement 10.6
human 10.5
youth 10.2
adorable 10.2
brother 10
face 10
granddaughter 9.9
couch 9.7
clothing 9.7
infant 9.7
30s 9.6
looking 9.6
pretty 9.1
care 9.1
two people 8.8
mom 8.7
generation 8.6
play 8.6
laughing 8.5
kids 8.5
friends 8.5
attractive 8.4
horizontal 8.4
holding 8.3
park 8.2
active 8.1
grandchild 7.9
real people 7.9
education 7.8
learning 7.5
lady 7.3
indoor 7.3
interior 7.1

Google
created on 2022-01-22

Face 98.4
Smile 96.7
Black 89.7
Standing 86.4
Picture frame 85.4
Gesture 85.3
Black-and-white 84
Style 83.9
Happy 80.7
Vintage clothing 76.6
Snapshot 74.3
Monochrome 72.2
Monochrome photography 71.6
Baby 71.1
Toddler 71
Event 69.6
Classic 69.1
Art 68.9
Flash photography 68.4
Room 67.9

Microsoft
created on 2022-01-22

human face 99.3
smile 97.6
clothing 97.5
wall 97.1
text 96.7
baby 96.1
indoor 93.3
toddler 92.3
person 92.1
posing 81.3
black 69.8
child 64.6
white 60.9
old 46.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 99.1%
Confused 0.3%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 1-7
Gender Female, 73.9%
Calm 98.7%
Sad 0.5%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%

Captions

Microsoft

Priscilla Lane holding a baby posing for the camera 89.5%
a vintage photo of Priscilla Lane et al. posing for the camera 89.4%
Priscilla Lane holding a baby posing for a photo 87.4%

Text analysis

Amazon

PROOF
SAINT
SAINT LOUIS
LOUIS
MARTIN
MARTIN SCHWEIG
SCHWEIG
13 PROOF
13

Google

12
SCHWE
SAINT
12 73 PROOF MARTIN SCHWE SAINT LOUIS
MARTIN
LOUIS
73
PROOF