Human Generated Data

Title

Untitled (baby with baby doll on arm chair)
Date

c. 1950, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.154

Human Generated Data

Title

Untitled (baby with baby doll on arm chair)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.2
Person 98.8
Human 98.8
Newborn 97
Baby 97
Person 96.9
Chair 91.4
Interior Design 82.1
Indoors 82.1
Person 77.3
Face 76.3
Couch 76.1
Home Decor 71.9
Clothing 70.8
Apparel 70.8
Living Room 67.1
Room 67.1
Portrait 60.8
Photography 60.8
Photo 60.8
Cushion 57
Shorts 56.1

Imagga
created on 2022-01-23

sofa 83.3
studio couch 77.7
convertible 62
furniture 55.5
room 54.8
home 43.9
bedroom 41.6
seat 41.3
interior 38.9
couch 36.7
pillow 35.2
house 30.9
bed 30.3
lamp 23.2
decor 22.1
adult 22
cushion 20.2
comfortable 20.1
chair 20
living 19.9
modern 19.6
luxury 18.9
indoors 18.5
sitting 18
armchair 17.3
style 16.3
attractive 16.1
person 16
window 15.6
rest 15.5
comfort 15.4
happy 15
design 14.9
table 14.7
indoor 14.6
hotel 14.3
relax 14.3
apartment 13.4
relaxation 13.4
wood 13.3
floor 13
lifestyle 13
fashion 12.8
pretty 12.6
people 12.3
light 12
happiness 11.8
smiling 11.6
love 11
casual 11
portrait 11
sleep 10.7
smile 10.7
night 10.7
sheet 10.3
architecture 10.2
relaxing 10
leisure 10
furnishings 9.9
cozy 9.8
sleeping 9.7
decoration 9.7
sexy 9.6
looking 9.6
leather 9.5
model 9.3
domestic 9.2
elegance 9.2
inside 9.2
human 9
motel 8.9
women 8.7
residential 8.6
resting 8.6
wall 8.6
business 8.5
blanket 8.5
contemporary 8.5
lying 8.5
one 8.2
stylish 8.1
cheerful 8.1
brown 8.1
man 8.1
mattress 7.9
divan 7.9
bedding 7.9
couple 7.8
lounge 7.8
carpet 7.8
jeans 7.6
20s 7.3
covered couch 7.2
cute 7.2
life 7

Google
created on 2022-01-23

Furniture 93.6
Comfort 88.1
Black-and-white 84.3
Style 84
Chair 80.5
Toddler 78.1
Monochrome photography 74.5
Baby 74
Monochrome 73.1
Room 69.6
Child 69.2
Sitting 68.2
Art 68
Living room 67.2
Font 66.3
Rectangle 65.5
Couch 65.4
Stock photography 64.5
Still life photography 57.9
Classic 56.1

Microsoft
created on 2022-01-23

baby 97.5
toddler 94.2
indoor 90.2
black and white 89.4
text 88
furniture 75.7
person 66.3
human face 65.1
couch 58

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Female, 83%
Happy 52.1%
Calm 46.5%
Sad 0.8%
Angry 0.2%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99%
Calm 36.8%
Sad 30.5%
Confused 10.2%
Angry 7.3%
Happy 6.1%
Disgusted 4.4%
Fear 2.6%
Surprised 2.2%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 89.2%
Angry 3.9%
Disgusted 2.4%
Confused 2.4%
Sad 0.9%
Surprised 0.6%
Fear 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Couch 76.1%

Captions

Microsoft

a person sleeping on a couch 65.6%
a person sleeping on a couch 53.8%
a person sleeping on a bed 53.7%