Human Generated Data

Title

Untitled (woman with infant)

Date

c. 1910

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.691

Human Generated Data

Title

Untitled (woman with infant)

People

Artist: Martin Schweig, American 20th century

Date

c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.3
Person 98.3
Furniture 90.8
Art 86.6
Painting 86.6
Face 85
Female 84.3
Teen 72.7
Door 71.6
Baby 70.9
Portrait 69.5
Photography 69.5
Photo 69.5
Girl 69.4
Woman 69.1
Apparel 63.4
Clothing 63.4
People 63.4
Couch 62.2
Kid 61.2
Child 61.2
Home Decor 57
Cabinet 56.9
Undershirt 55.9
Newborn 55

Imagga
created on 2022-01-08

mother 37.8
kin 37.8
love 37.1
family 36.5
man 33.6
couple 31.4
home 31.1
male 30.5
people 30.1
happy 28.8
parent 28.8
child 28.2
adult 27.9
father 27.3
portrait 25.2
happiness 25.1
couch 24.2
interior 22.1
smiling 20.3
husband 20.2
together 20.2
person 19.8
daughter 19.5
lifestyle 18.8
relationship 18.7
sofa 18.4
room 18.1
smile 17.8
wife 17.1
son 16.8
groom 16.5
attractive 16.1
kid 16
dad 15.5
lady 15.4
pretty 15.4
sexy 15.3
casual 15.3
romance 14.3
face 14.2
baby 14.1
brother 14.1
model 14
relaxing 13.6
boy 13
cute 12.9
sitting 12.9
fun 12.7
two 12.7
women 12.7
married 12.5
loving 12.4
looking 12
parents 11.7
house 11.7
holding 11.6
indoors 11.4
cheerful 11.4
human 11.3
grandfather 11.2
dress 10.8
bride 10.6
hair 10.3
expression 10.2
wedding 10.1
children 10
childhood 9.9
romantic 9.8
fashion 9.8
passion 9.4
joy 9.2
grandma 9.2
sensual 9.1
old 9.1
blond 9
life 8.7
affectionate 8.7
boyfriend 8.7
girlfriend 8.7
men 8.6
youth 8.5
adults 8.5
black 8.4
sibling 8.4
clothing 8.3
indoor 8.2
handsome 8
bedroom 7.9
brunette 7.8
hug 7.7
30s 7.7
comfortable 7.6
bed 7.6
females 7.6
elegance 7.6
togetherness 7.6
bouquet 7.6
leisure 7.5
one 7.5
emotion 7.4
playing 7.3
girls 7.3
body 7.2
holiday 7.2
little 7.1
domestic 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

baby 99
clothing 98.2
human face 98
toddler 97.4
person 96.3
child 92.2
text 92.2
indoor 85.2
window 81
smile 80.3
old 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 98.5%
Happy 0.7%
Sad 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 0-3
Gender Male, 93.6%
Happy 78.7%
Calm 9.2%
Surprised 8.8%
Confused 1.6%
Fear 0.7%
Disgusted 0.4%
Angry 0.3%
Sad 0.2%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Painting 86.6%

Captions

Microsoft

a person sitting in front of a window 86.9%
a girl sitting in front of a window 77.8%
a person standing in front of a window 77.7%

Text analysis

Amazon

CHWEIG
CHWEIG ST Levis
Levis
ST

Google

Leves.
Leves.