Human Generated Data

Title

Untitled (woman with baby)
Date

c. 1920
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.740

Human Generated Data

Title

Untitled (woman with baby)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 97
Newborn 95.9
Baby 95.9
Person 95.1
Furniture 88
Person 81
Face 71
Photography 67
Photo 67
Portrait 66
Bed 63.8

Imagga
created on 2022-01-08

person 31.3
home 31.1
adult 28.5
child 27.2
attractive 25.9
people 25.1
bed 22.8
mother 20
love 19.7
lifestyle 19.5
happy 19.4
portrait 19.4
parent 18.8
care 18.1
model 17.9
male 17.8
man 17.5
sitting 17.2
room 16.4
face 16.3
indoors 15.8
happiness 15.7
couch 15.5
sexy 15.3
women 15
patient 15
sofa 15
smile 15
pretty 14.7
smiling 14.5
looking 14.4
couple 13.9
baby 13.7
cute 13.6
father 13.4
family 13.3
health 13.2
lying 13.2
seat 13.1
lady 13
body 12.8
relaxation 12.6
nurse 12.2
hospital 12
hair 11.9
blond 11.8
resting 11.4
human 11.3
bedroom 11.1
casual 11
relax 11
dad 10.9
cheerful 10.6
life 10.6
one 10.5
relaxing 10
holding 9.9
romantic 9.8
medical 9.7
relationship 9.4
house 9.2
indoor 9.1
girls 9.1
hand 9.1
pillow 9.1
fashion 9
healthy 8.8
sleep 8.8
affectionate 8.7
boy 8.7
skin 8.7
armchair 8.5
females 8.5
two 8.5
senior 8.4
old 8.4
treatment 8.3
sensual 8.2
childhood 8.1
kid 8
interior 8
groom 7.9
daughter 7.8
affection 7.7
mid adult 7.7
modern 7.7
device 7.7
elderly 7.7
illness 7.6
dream 7.6
relaxed 7.5
leisure 7.5
mature 7.4
children 7.3
black 7.2
spa 7.2
romance 7.1
handsome 7.1
little 7.1

Google
created on 2022-01-08

Comfort 87.6
Sleeve 80.4
Elbow 75.4
Baby 73.5
Vintage clothing 70.5
Sitting 66.8
Stock photography 62.7
Toddler 62.4
Monochrome photography 62.2
Monochrome 62.1
Classic 59.7
Art 59.1
Knee 58.2
Room 57
Chair 55
Retro style 53.9
Child 52.7

Microsoft
created on 2022-01-08

person 99.9
baby 99
text 99
toddler 95.8
wall 95.5
human face 93.7
clothing 91.9
white goods 78.7
child 72.4
black and white 65.4
boy 58.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Female, 98.9%
Calm 67.8%
Disgusted 12.1%
Angry 8.3%
Sad 4.5%
Confused 2.7%
Happy 2.3%
Surprised 1.3%
Fear 0.9%

AWS Rekognition

Age 0-3
Gender Male, 98.4%
Calm 79.6%
Happy 10%
Surprised 3.4%
Confused 2.5%
Disgusted 1.6%
Sad 1%
Fear 1%
Angry 0.9%

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.1%

Captions

Microsoft

a person holding a baby 35.5%
a person sitting on a bed 35.4%
a person looking at the camera 35.3%