Human Generated Data

Title

St. Patrick's Day, New York City
Date

1960s
People

Artist: Paola Shoemaker, American active 1960s-1970s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3358

Human Generated Data

Title

St. Patrick's Day, New York City

People

Artist: Paola Shoemaker, American active 1960s-1970s

Date

1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3358

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.9
Apparel 99.9
Person 98.5
Human 98.5
Person 97.4
Person 97.2
Person 95.7
Person 95.7
Face 95.5
Hat 77.9
Overcoat 74.8
Coat 74.8
Fashion 69.2
Beard 68.4
Wedding 58.1
Sun Hat 57.7
Gown 56.6
Portrait 55.2
Photography 55.2
Photo 55.2

Clarifai
created on 2023-10-25

people 99.8
group 99
adult 97.9
woman 97.4
wear 97.3
lid 96.7
child 96.5
portrait 95.6
man 95.5
veil 94.5
dress 92.8
costume 92.6
several 91.7
outfit 91.1
outerwear 90.6
three 90.6
street 89.4
retro 88.6
coat 87.4
group together 87.2

Imagga
created on 2022-01-09

statue 44.8
architecture 28.3
metropolitan 26
old 24.4
sculpture 24.4
monument 24.3
religion 23.3
history 22.4
building 21.9
city 21.6
landmark 19.9
church 19.4
art 19.2
tourism 19
travel 18.3
ancient 17.3
historic 16.5
stone 16.2
famous 15.8
cemetery 14.7
culture 14.5
dress 14.5
kin 14.1
catholic 14
marble 13.6
historical 13.2
cathedral 12.4
column 12.2
religious 12.2
detail 12.1
people 11.7
groom 11.5
god 11.5
tourist 11.1
facade 10.7
holy 10.6
faith 10.5
antique 10.4
clothing 9.4
mask 9.2
traditional 9.1
new 8.9
person 8.7
saint 8.7
spirituality 8.6
covering 8.5
costume 8.4
sky 8.3
window 8
urban 7.9
chapel 7.8
face 7.8
boutique 7.8
memorial 7.6
cross 7.5
gown 7.5
town 7.4
symbol 7.4
temple 7.2
tower 7.2
bride 7.1
portrait 7.1
love 7.1

Google
created on 2022-01-09

Fashion 88.3
Hat 88
Black-and-white 84.4
Style 83.8
Headgear 83.7
Building 83.6
Window 80.7
Art 77
Monochrome photography 76.4
Sun hat 75.2
Monochrome 75.1
Vintage clothing 74.8
Event 72.1
Classic 70.2
One-piece garment 68.2
Street fashion 67.2
History 65.1
Room 63.5
Formal wear 63
Fashion design 60.4

Microsoft
created on 2022-01-09

clothing 96.8
text 95.3
person 94
gallery 93.8
dress 87.8
woman 86.6
room 80.4
black and white 78.4
wedding dress 76.5
man 70.2
bride 67

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 98.1%
Angry 0.4%
Surprised 0.4%
Fear 0.3%
Calm 0.3%
Confused 0.2%
Sad 0.2%
Disgusted 0.1%

AWS Rekognition

Age 16-24
Gender Female, 100%
Calm 74%
Happy 20.2%
Sad 2.5%
Confused 1%
Surprised 0.8%
Angry 0.7%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 36-44
Gender Female, 99.8%
Happy 99.4%
Calm 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 95.6%
Confused 2.7%
Angry 0.7%
Sad 0.2%
Happy 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 86.3%
Angry 4.6%
Sad 3.7%
Confused 1.5%
Disgusted 1.1%
Happy 1%
Surprised 0.9%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Hat 77.9%

Categories

Imagga

streetview architecture 85.6%
paintings art 14.2%

Text analysis

Amazon

Plymouth

Google

en EI E
en
EI
E