Human Generated Data

Title

Untitled (family in living room)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17147

Human Generated Data

Title

Untitled (family in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17147

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.7
Apparel 99.7
Person 98.3
Human 98.3
Person 97.9
Person 97.7
Shoe 96.5
Footwear 96.5
Person 96.4
Person 93.8
Female 89.4
Person 88.4
Dress 84.1
Shoe 80.6
Robe 74.1
Fashion 74.1
Floor 72.5
Person 71.8
Woman 69.9
Gown 68.9
Girl 68.5
Evening Dress 64.6
Shoe 63.9
People 62.2
Suit 59.3
Coat 59.3
Overcoat 59.3
Drawing 57.6
Art 57.6
Costume 56.7

Clarifai
created on 2023-10-29

people 99.8
child 98.5
monochrome 97
group 96.8
dancing 96.4
dress 95.2
wear 94.2
woman 92
wedding 91.2
man 90.1
three 89.9
adult 89.3
family 87.8
retro 87.7
girl 87.2
nostalgia 87.1
dancer 83.7
outfit 82.7
costume 82.4
fashion 82

Imagga
created on 2022-02-26

people 30.7
adult 23.6
kin 23.6
person 21.2
women 20.5
happy 19.4
fashion 18.8
man 18.8
mother 18.4
portrait 18.1
couple 16.5
male 16.3
smile 15
men 14.6
two 14.4
home 14.3
family 14.2
happiness 14.1
attractive 14
standing 13.9
business 13.4
together 13.1
lady 13
group 12.9
dress 12.6
pretty 12.6
outfit 12.5
smiling 12.3
cute 12.2
child 12
looking 12
walking 11.4
grandfather 11.3
style 11.1
parent 10.7
fashionable 10.4
model 10.1
hat 10
girls 10
pose 10
sibling 10
old 9.7
human 9.7
new 9.7
room 9.4
work 9.4
clothes 9.4
house 9.2
modern 9.1
nurse 9
cheerful 8.9
sexy 8.8
businessman 8.8
shop 8.7
black 8.5
casual 8.5
friends 8.4
shopping 8.3
fun 8.2
children 8.2
kid 8
clothing 8
lifestyle 7.9
holiday 7.9
boutique 7.8
store 7.6
elegance 7.6
togetherness 7.5
joy 7.5
senior 7.5
hospital 7.5
window 7.4
stylish 7.2
brother 7.2
daughter 7.2
childhood 7.2
coat 7.2
interior 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

dress 98.6
clothing 95.2
text 91.5
person 87.7
footwear 77.2
woman 73.3
girl 65.2
wedding dress 56.6
skirt 51.7
room 42.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 98.3%
Happy 50.4%
Calm 28.5%
Sad 9.9%
Confused 5.5%
Surprised 2.1%
Disgusted 1.5%
Angry 1.4%
Fear 0.7%

AWS Rekognition

Age 31-41
Gender Female, 82.8%
Calm 47%
Sad 18%
Surprised 8.7%
Happy 7.7%
Angry 5.5%
Confused 5.5%
Disgusted 3.9%
Fear 3.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 98.3%
Person 97.9%
Person 97.7%
Person 96.4%
Person 93.8%
Person 88.4%
Person 71.8%
Shoe 96.5%
Shoe 80.6%
Shoe 63.9%

Categories

Imagga

paintings art 100%

Text analysis

Amazon

19
TOA

Google

19
19