Human Generated Data

Title

Untitled (family portrait on couch)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17135

Human Generated Data

Title

Untitled (family portrait on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17135

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 100
Couch 99
Person 98.4
Human 98.4
Living Room 96.1
Room 96.1
Indoors 96.1
Person 96
Person 91.5
Home Decor 90.1
Clothing 89.2
Apparel 89.2
Face 83.7
Female 70.9
Chair 70.7
People 69.7
Portrait 66.3
Photography 66.3
Photo 66.3
Kid 61.3
Child 61.3
Baby 56.8
Dress 55.4
Table 55.2

Clarifai
created on 2023-10-28

people 99.7
monochrome 97.9
man 97.4
child 96.9
sit 96.6
adult 96.6
woman 96.5
group 95.7
nostalgia 91.7
group together 91.1
indoors 90.1
many 89.1
administration 87.8
family 87.5
wear 86.7
sitting 85.4
education 84.6
music 83.5
room 83.4
retro 83

Imagga
created on 2022-02-26

home 41.5
room 40.1
grandfather 34.2
chair 31.6
seat 26.3
furniture 25.9
interior 25.6
armchair 23.9
indoors 23.7
sitting 23.2
hospital 22.1
house 21.7
person 21.5
man 21.5
couch 21.2
male 20.6
people 19.5
happy 19.4
indoor 19.2
lifestyle 18.8
adult 18.7
sofa 18.7
smiling 17.4
happiness 17.2
cheerful 17.1
living 17.1
relax 16.8
relaxation 15.9
couple 15.7
family 15.1
bed 14.5
bedroom 14.4
portrait 14.2
rocking chair 13.9
table 13.8
pillow 13.6
casual 13.6
senior 13.1
floor 13
face 12.8
living room 12.7
child 12.6
comfortable 12.4
light 12
window 11.9
domestic 11.9
women 11.9
old 11.8
relaxing 11.8
wood 11.7
men 11.2
love 11
sleep 10.7
mother 10.6
apartment 10.5
together 10.5
fun 10.5
enjoyment 10.3
day 10.2
decoration 10.1
color 10
bright 10
life 9.8
modern 9.8
kid 9.7
one 9.7
mature 9.3
smile 9.3
rest 9.2
leisure 9.1
alone 9.1
holding 9.1
design 9
lady 8.9
looking 8.8
comfort 8.7
elderly 8.6
loving 8.6
sit 8.5
togetherness 8.5
style 8.2
good mood 7.8
architecture 7.8
glass 7.8
having 7.7
attractive 7.7
residential 7.7
resting 7.6
estate 7.6
relaxed 7.5
coffee 7.4
office 7.4
clothing 7.4
inside 7.4
children 7.3
tourist 7.2
computer 7.2
handsome 7.1
patient 7.1
antique 7.1
decor 7.1
father 7

Google
created on 2022-02-26

Black 89.6
Musical instrument 85.4
Black-and-white 84.2
Style 83.9
Chair 83.8
Art 81.4
Monochrome 75
Monochrome photography 74.7
Building 71.9
Room 68
Painting 67.7
Font 67.5
Visual arts 65.7
Sitting 62.5
Illustration 60.7
Music 59.8
Still life photography 58.3
Classic 55.5
Photographic paper 50.8
Musician 50

Microsoft
created on 2022-02-26

text 91.9
furniture 82.4
house 58.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Female, 95.4%
Happy 40.5%
Surprised 39.2%
Calm 12%
Sad 3.2%
Confused 2.2%
Fear 1.6%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 40.6%
Surprised 19.1%
Happy 14.4%
Sad 10.2%
Fear 10.1%
Angry 2.3%
Disgusted 1.8%
Confused 1.5%

AWS Rekognition

Age 42-50
Gender Male, 85.2%
Sad 92.6%
Happy 4.3%
Fear 0.7%
Confused 0.7%
Surprised 0.7%
Calm 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 48-56
Gender Female, 62.8%
Sad 93.4%
Calm 3.7%
Confused 1.2%
Angry 0.6%
Happy 0.4%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Couch
Person
Couch 99%
Person 98.4%
Person 96%
Person 91.5%

Categories

Imagga

interior objects 64.6%
food drinks 34.1%
paintings art 1.2%

Captions

Microsoft
created on 2022-02-26

a person sitting in front of a window 32.7%

Text analysis

Amazon

- XAGON

Google

www
www