Human Generated Data

Title

Untitled (family portrait on couch)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17135

Human Generated Data

Title

Untitled (family portrait on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 100
Couch 99
Human 98.4
Person 98.4
Room 96.1
Living Room 96.1
Indoors 96.1
Person 96
Person 91.5
Home Decor 90.1
Clothing 89.2
Apparel 89.2
Face 83.7
Female 70.9
Chair 70.7
People 69.7
Photography 66.3
Portrait 66.3
Photo 66.3
Child 61.3
Kid 61.3
Baby 56.8
Dress 55.4
Table 55.2

Imagga
created on 2022-02-26

home 41.5
room 40.1
grandfather 34.2
chair 31.6
seat 26.3
furniture 25.9
interior 25.6
armchair 23.9
indoors 23.7
sitting 23.2
hospital 22.1
house 21.7
person 21.5
man 21.5
couch 21.2
male 20.6
people 19.5
happy 19.4
indoor 19.2
lifestyle 18.8
adult 18.7
sofa 18.7
smiling 17.4
happiness 17.2
cheerful 17.1
living 17.1
relax 16.8
relaxation 15.9
couple 15.7
family 15.1
bed 14.5
bedroom 14.4
portrait 14.2
rocking chair 13.9
table 13.8
pillow 13.6
casual 13.6
senior 13.1
floor 13
face 12.8
living room 12.7
child 12.6
comfortable 12.4
light 12
window 11.9
domestic 11.9
women 11.9
old 11.8
relaxing 11.8
wood 11.7
men 11.2
love 11
sleep 10.7
mother 10.6
apartment 10.5
together 10.5
fun 10.5
enjoyment 10.3
day 10.2
decoration 10.1
color 10
bright 10
life 9.8
modern 9.8
kid 9.7
one 9.7
mature 9.3
smile 9.3
rest 9.2
leisure 9.1
alone 9.1
holding 9.1
design 9
lady 8.9
looking 8.8
comfort 8.7
elderly 8.6
loving 8.6
sit 8.5
togetherness 8.5
style 8.2
good mood 7.8
architecture 7.8
glass 7.8
having 7.7
attractive 7.7
residential 7.7
resting 7.6
estate 7.6
relaxed 7.5
coffee 7.4
office 7.4
clothing 7.4
inside 7.4
children 7.3
tourist 7.2
computer 7.2
handsome 7.1
patient 7.1
antique 7.1
decor 7.1
father 7

Google
created on 2022-02-26

Black 89.6
Musical instrument 85.4
Black-and-white 84.2
Style 83.9
Chair 83.8
Art 81.4
Monochrome 75
Monochrome photography 74.7
Building 71.9
Room 68
Painting 67.7
Font 67.5
Visual arts 65.7
Sitting 62.5
Illustration 60.7
Music 59.8
Still life photography 58.3
Classic 55.5
Photographic paper 50.8
Musician 50

Microsoft
created on 2022-02-26

text 91.9
furniture 82.4
house 58.1

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Female, 95.4%
Happy 40.5%
Surprised 39.2%
Calm 12%
Sad 3.2%
Confused 2.2%
Fear 1.6%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 40.6%
Surprised 19.1%
Happy 14.4%
Sad 10.2%
Fear 10.1%
Angry 2.3%
Disgusted 1.8%
Confused 1.5%

AWS Rekognition

Age 42-50
Gender Male, 85.2%
Sad 92.6%
Happy 4.3%
Fear 0.7%
Confused 0.7%
Surprised 0.7%
Calm 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 48-56
Gender Female, 62.8%
Sad 93.4%
Calm 3.7%
Confused 1.2%
Angry 0.6%
Happy 0.4%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Couch 99%
Person 98.4%

Captions

Microsoft

a person sitting in front of a window 32.7%

Text analysis

Amazon

- XAGON

Google

www
www