Human Generated Data

Title

Untitled (family portrait in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16577

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16577

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Person 99.2
Human 99.2
Person 99.1
Person 98.9
Furniture 97.1
Person 95.4
Chair 93.8
People 82.6
Clothing 78.3
Apparel 78.3
Couch 78
Person 76.4
Female 75.2
Sitting 72.1
Living Room 71.9
Indoors 71.9
Room 71.9
Art 64.7
Girl 64.6
Photography 63.1
Photo 63.1
Face 62.8
Woman 57.8
Text 56.9

Clarifai
created on 2023-10-29

people 99.9
group 99.1
group together 97.9
man 97.7
adult 95.8
several 95.3
monochrome 94.1
child 93.5
three 92.8
woman 92.7
chair 92
four 91.6
many 90.5
family 89.7
leader 88
sit 87.2
wedding 84.9
nostalgia 84.3
sibling 82.9
seat 82.8

Imagga
created on 2022-02-12

home 30.3
couple 26.1
people 25.6
person 22.7
room 22
happy 21.9
flowers 20.8
senior 20.6
happiness 20.3
bride 20.1
kin 19.7
man 19.5
smiling 18.8
adult 18.7
male 18.5
wedding 18.4
house 18.4
school 17.8
teacher 17.7
bouquet 17.5
portrait 17.4
family 16.9
indoors 16.7
love 16.6
men 15.4
classroom 15.2
women 15
together 14.9
table 14.9
lifestyle 14.4
building 13.9
cheerful 13.8
educator 13.8
groom 13.5
elderly 13.4
marriage 13.3
sitting 12.9
chair 12.8
two 12.7
indoor 11.9
old 11.8
mother 11.8
structure 11.5
flower 11.5
interior 11.5
husband 11.4
day 11
married 10.5
outdoors 10.4
wife 10.4
celebration 10.4
mature 10.2
architecture 10.1
wed 9.8
fun 9.7
bridal 9.7
professional 9.7
window 9.6
enjoying 9.5
friends 9.4
friendship 9.3
smile 9.3
face 9.2
decoration 8.9
living room 8.8
look 8.7
having 8.7
retirement 8.6
party 8.6
loving 8.6
musical instrument 8.5
rose 8.4
drink 8.3
camera 8.3
grandma 8.1
dress 8.1
restaurant 8.1
group 8
romantic 8
salon 7.9
sixties 7.8
60s 7.8
glass 7.8
two people 7.8
older 7.8
luxury 7.7
modern 7.7
drinking 7.6
life 7.6
living 7.6
dinner 7.6
horizontal 7.5
child 7.5
joy 7.5
furniture 7.5
wine 7.4
lady 7.3
alone 7.3
daughter 7.3
aged 7.2
holiday 7.2
father 7.1
decor 7.1

Google
created on 2022-02-12

Microsoft
created on 2022-02-12

window 98.8
person 70.7
house 69
text 68.9
white 62.4
dining table 6.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Female, 81.2%
Happy 80.6%
Calm 7.3%
Sad 6%
Surprised 2.2%
Confused 1.6%
Angry 1%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Female, 65.7%
Calm 48.5%
Sad 43.9%
Happy 2.5%
Confused 2.4%
Disgusted 1%
Surprised 0.8%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Sad 85.1%
Happy 13.7%
Angry 0.3%
Fear 0.3%
Surprised 0.2%
Confused 0.2%
Calm 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.2%
Happy 42.9%
Calm 34.3%
Sad 9.2%
Surprised 9.1%
Disgusted 1.6%
Angry 1.5%
Confused 0.9%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Happy 96.5%
Calm 1.8%
Sad 0.9%
Confused 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.2%
Person 99.1%
Person 98.9%
Person 95.4%
Person 76.4%

Categories

Imagga

interior objects 96.4%
paintings art 3.1%

Text analysis

Amazon

VLEIT
9
KOREA