Human Generated Data

Title

Untitled (couple in costume, Mr. and Mrs. Carlos Ryan)
Date

c. 1929
People

Artist: Curtis Studio, American active 1891 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1281

Human Generated Data

Title

Untitled (couple in costume, Mr. and Mrs. Carlos Ryan)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

c. 1929

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Person 99.3
Human 99.3
Person 98.9
Costume 97.6
Shoe 95.4
Footwear 95.4
Shoe 92.9
Sombrero 91
Clock Tower 88.7
Building 88.7
Architecture 88.7
Tower 88.7
Coat 85.3
Overcoat 83.9
Dress 62.9
Portrait 60.7
Photography 60.7
Face 60.7
Photo 60.7
Shoe 56.4
Hat 55.2

Imagga
created on 2022-01-22

brass 89.5
trombone 83.6
wind instrument 70.8
musical instrument 47.4
statue 24.9
religion 20.6
sculpture 19.5
man 18.8
art 17.7
culture 17.1
church 16.6
person 16.3
old 15.3
portrait 14.9
male 14.2
black 14.2
architecture 14.1
ancient 13.8
vintage 13.2
monument 13.1
people 12.8
history 12.5
religious 12.2
costume 12.1
warrior 11.7
cornet 11.7
traditional 11.6
holy 11.6
fashion 11.3
historical 11.3
antique 11.2
stone 11
face 10.6
faith 10.5
god 10.5
adult 10.3
model 10.1
dress 9.9
catholic 9.8
war 9.6
golden 9.5
hat 9.4
sword 9.3
tradition 9.2
interior 8.8
bible 8.8
building 8.7
hair 8.7
spirituality 8.6
wall 8.5
sax 8.5
famous 8.4
clothing 8.3
one 8.2
lady 8.1
weapon 8.1
detail 8
soldier 7.8
artistic 7.8
men 7.7
military 7.7
attractive 7.7
cathedral 7.7
human 7.5
helmet 7.5
style 7.4
figure 7.3
metal 7.2
sexy 7.2
body 7.2
posing 7.1
travel 7

Google
created on 2022-01-22

Hat 87.3
Sleeve 87.1
Collar 82.1
Art 81.1
Picture frame 78.2
Costume hat 74.3
Overcoat 73.8
Vintage clothing 73.4
Formal wear 71
Victorian fashion 70.1
Uniform 70
Painting 68
Blazer 67.8
History 65.2
Suit 64.9
Classic 64.7
Stock photography 64.1
Sun hat 63.4
Illustration 61.8
Visual arts 60.8

Microsoft
created on 2022-01-22

person 98.3
woman 97.8
outdoor 97.2
text 96.4
clothing 95.4
standing 92.6
drawing 87.8
posing 82.8
hat 82.2
fashion accessory 81.8
sketch 79.8
human face 67.1
coat 59.1
smile 53.6
old 50.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Female, 99.9%
Happy 95%
Calm 1.7%
Surprised 1.2%
Disgusted 0.6%
Fear 0.5%
Confused 0.4%
Angry 0.3%
Sad 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 86.4%
Confused 9.7%
Happy 2.1%
Sad 0.6%
Angry 0.5%
Surprised 0.3%
Disgusted 0.3%
Fear 0.2%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 95.4%
Clock Tower 88.7%
Coat 85.3%
Hat 55.2%

Captions

Microsoft

a woman standing in front of a building 93.3%
a woman standing in front of a group of people posing for a photo 82.3%
a woman standing in front of a group of people posing for the camera 82.2%