Human Generated Data

Title

Untitled (family portrait in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16577

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Human 99.2
Person 99.2
Person 99.1
Person 98.9
Furniture 97.1
Person 95.4
Chair 93.8
People 82.6
Clothing 78.3
Apparel 78.3
Couch 78
Person 76.4
Female 75.2
Sitting 72.1
Living Room 71.9
Room 71.9
Indoors 71.9
Art 64.7
Girl 64.6
Photo 63.1
Photography 63.1
Face 62.8
Woman 57.8
Text 56.9

Imagga
created on 2022-02-12

home 30.3
couple 26.1
people 25.6
person 22.7
room 22
happy 21.9
flowers 20.8
senior 20.6
happiness 20.3
bride 20.1
kin 19.7
man 19.5
smiling 18.8
adult 18.7
male 18.5
wedding 18.4
house 18.4
school 17.8
teacher 17.7
bouquet 17.5
portrait 17.4
family 16.9
indoors 16.7
love 16.6
men 15.4
classroom 15.2
women 15
together 14.9
table 14.9
lifestyle 14.4
building 13.9
cheerful 13.8
educator 13.8
groom 13.5
elderly 13.4
marriage 13.3
sitting 12.9
chair 12.8
two 12.7
indoor 11.9
old 11.8
mother 11.8
structure 11.5
flower 11.5
interior 11.5
husband 11.4
day 11
married 10.5
outdoors 10.4
wife 10.4
celebration 10.4
mature 10.2
architecture 10.1
wed 9.8
fun 9.7
bridal 9.7
professional 9.7
window 9.6
enjoying 9.5
friends 9.4
friendship 9.3
smile 9.3
face 9.2
decoration 8.9
living room 8.8
look 8.7
having 8.7
retirement 8.6
party 8.6
loving 8.6
musical instrument 8.5
rose 8.4
drink 8.3
camera 8.3
grandma 8.1
dress 8.1
restaurant 8.1
group 8
romantic 8
salon 7.9
sixties 7.8
60s 7.8
glass 7.8
two people 7.8
older 7.8
luxury 7.7
modern 7.7
drinking 7.6
life 7.6
living 7.6
dinner 7.6
horizontal 7.5
child 7.5
joy 7.5
furniture 7.5
wine 7.4
lady 7.3
alone 7.3
daughter 7.3
aged 7.2
holiday 7.2
father 7.1
decor 7.1

Google
created on 2022-02-12

Microsoft
created on 2022-02-12

window 98.8
person 70.7
house 69
text 68.9
white 62.4
dining table 6.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Female, 81.2%
Happy 80.6%
Calm 7.3%
Sad 6%
Surprised 2.2%
Confused 1.6%
Angry 1%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Female, 65.7%
Calm 48.5%
Sad 43.9%
Happy 2.5%
Confused 2.4%
Disgusted 1%
Surprised 0.8%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Sad 85.1%
Happy 13.7%
Angry 0.3%
Fear 0.3%
Surprised 0.2%
Confused 0.2%
Calm 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.2%
Happy 42.9%
Calm 34.3%
Sad 9.2%
Surprised 9.1%
Disgusted 1.6%
Angry 1.5%
Confused 0.9%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Happy 96.5%
Calm 1.8%
Sad 0.9%
Confused 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo in front of a window 87.3%
a group of people standing in front of a window 85.7%
a group of people standing next to a window 85.6%

Text analysis

Amazon

VLEIT
9
KOREA