Human Generated Data

Title

Untitled (two women and baby)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16648

Human Generated Data

Title

Untitled (two women and baby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-18

Clothing 98.4
Apparel 98.4
Chair 97.3
Furniture 97.3
Face 95.8
Human 95.8
Person 95.2
Female 80.9
People 80.5
Dress 79.7
Photo 74.6
Portrait 74.6
Photography 74.6
Costume 72.7
Woman 66.8
Coat 66.6
Overcoat 66.6
Suit 66.6
Girl 65.3
Indoors 64.9
Couch 61.1
Hat 61.1
Room 60
Living Room 59.5
Child 59.1
Kid 59.1
Floor 58.9
Sitting 58.1
Baby 58.1

Imagga
created on 2022-02-18

groom 45.3
couple 44.4
people 36.2
love 34.7
bride 31.2
man 29.6
happiness 29
dress 28.9
wedding 28.5
smiling 27.5
happy 26.9
adult 26.8
women 24.5
male 22.8
home 22.3
married 22
together 21
person 20.9
wife 20.9
husband 20.2
negative 20.2
celebration 19.9
bouquet 19.9
cheerful 19.5
two 19.5
family 18.7
mother 18.6
indoors 17.6
men 17.2
smile 17.1
marriage 17.1
day 16.5
kin 16.4
sitting 16.3
portrait 16.2
film 15.9
lifestyle 15.9
veil 15.7
gown 15.6
nurse 14.1
fun 13.5
romance 13.4
romantic 13.4
holiday 12.9
ceremony 12.6
photographic paper 12.3
togetherness 12.3
flowers 12.2
room 11.6
fashion 11.3
senior 11.2
pretty 11.2
bridal 10.7
loving 10.5
outdoors 10.4
enjoying 10.4
pair 10.4
daughter 10.4
salon 10.3
holding 9.9
father 9.8
grandfather 9.7
lady 9.7
tenderness 9.7
child 9.3
elegance 9.2
face 9.2
suit 9
hospital 8.8
kiss 8.8
engagement 8.7
sofa 8.6
comfortable 8.6
bed 8.5
grandma 8.5
flower 8.5
attractive 8.4
relaxation 8.4
house 8.4
event 8.3
camera 8.3
indoor 8.2
girls 8.2
photographic equipment 8.2
group 8.1
sexy 8
interior 8
bridegroom 7.9
wedded 7.9
newly 7.9
living room 7.8
casual clothing 7.8
two people 7.8
parent 7.7
youth 7.7
drinking 7.7
talking 7.6
drink 7.5
friends 7.5
relationship 7.5
future 7.4
mature 7.4
new 7.3
life 7.2
hair 7.1
summer 7.1

Google
created on 2022-02-18

Photograph 94.1
Window 93
Black-and-white 84.1
Style 84
Monochrome 77.4
Chair 76.3
Monochrome photography 75.8
Flash photography 75.7
Snapshot 74.3
Art 73.5
Table 69.8
Automotive design 67.2
Sitting 66.7
Room 66.6
House 66
Stock photography 64.4
Visual arts 62.5
Vintage clothing 59.3
Still life photography 58.4
Suit 54.8

Microsoft
created on 2022-02-18

text 93.5
person 92.8
clothing 92.5
outdoor 89.1
human face 69.1
woman 68.4
smile 67.3
posing 45.8

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 98.1%
Happy 96.2%
Confused 1.3%
Sad 0.9%
Surprised 0.5%
Disgusted 0.4%
Angry 0.3%
Calm 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Female, 74.2%
Happy 56.6%
Surprised 22.1%
Sad 11.6%
Calm 4%
Fear 1.9%
Disgusted 1.7%
Angry 1.6%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.2%

Captions

Microsoft

a man and woman sitting next to a window 62.5%
a man and a woman sitting in front of a window 62.4%
a man and a woman sitting next to a window 62.3%

Text analysis

Amazon

KODAK
2.4