Human Generated Data

Title

Untitled (standing couple)
Date

c. 1920
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.727

Human Generated Data

Title

Untitled (standing couple)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Apparel 99.8
Clothing 99.8
Human 98.2
Person 98.2
Person 93.6
Overcoat 81.1
Suit 81.1
Sleeve 78.9
Lace 78.2
People 74
Fashion 71.4
Robe 71.4
Gown 68.5
Evening Dress 68.5
Long Sleeve 66.3
Tuxedo 63.6
Wedding 63.2
Tie 62.7
Accessory 62.7
Accessories 62.7
Wedding Gown 59.1
Home Decor 55.2
Coat 50.8

Imagga
created on 2022-01-08

statue 53.1
kin 41.5
sculpture 36.7
ruler 27.7
religion 25.1
old 24.4
monument 24.3
ancient 24.2
history 24.2
architecture 23.6
stone 21.1
god 21.1
religious 19.7
art 18.4
catholic 17.8
marble 17.6
antique 17.4
person 16.5
culture 16.2
tourism 15.7
people 15.6
historical 15.1
column 14.9
historic 14.7
groom 14.6
man 14.1
church 13.9
portrait 13.6
building 13.5
travel 13.4
temple 12.9
figure 12.7
landmark 12.6
holy 12.5
city 12.5
famous 12.1
symbol 11.5
face 11.4
love 11.1
suit 11
pray 10.7
male 10.6
saint 10.6
spirituality 10.6
faith 10.5
bow tie 10.4
vintage 9.9
spiritual 9.6
clothing 9.4
dress 9
roman 8.8
couple 8.7
traditional 8.3
fashion 8.3
human 8.3
style 8.2
mother 8.1
detail 8.1
decoration 8
carving 7.9
adult 7.8
museum 7.8
prayer 7.7
retro 7.4
design 7.3
peace 7.3
lady 7.3
tourist 7.3
happiness 7.1
model 7

Google
created on 2022-01-08

Outerwear 95.2
Sleeve 87
Standing 86.4
Victorian fashion 79.2
Fashion design 76.3
Formal wear 75.3
Vintage clothing 75.2
Blazer 74.4
Classic 73.5
Art 72.8
One-piece garment 66.7
Picture frame 66.2
Event 62.8
History 62.7
Visual arts 62.3
Monarchy 59.4
Collar 59
Overcoat 55.7
Retro style 55.3
Suit 54.7

Microsoft
created on 2022-01-08

wall 99.1
person 98.9
text 98.2
dress 94.4
clothing 93.8
standing 93.3
indoor 92.2
woman 90.1
human face 86
posing 82.6
wedding dress 74.9
vintage clothing 70.3
suit 65.5
old 63.3
smile 57.8
retro style 53.4
bride 51.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 100%
Confused 0%
Happy 0%
Surprised 0%
Angry 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Female, 99.9%
Calm 99.4%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Suit 81.1%
Tie 62.7%
Coat 50.8%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 95.6%
a man and woman standing in front of a mirror posing for the camera 82.1%
a person standing in front of a mirror posing for the camera 82%

Text analysis

Amazon

SCHWEIG
ST.LOUIS
O

Google

SCHWEIG ST. LOUIS TE
LOUIS
TE
SCHWEIG
ST.