Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.223.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Clothing 99.9
Apparel 99.9
Human 99.3
Person 99.3
Person 98.6
Person 97.5
Hat 90.4
Sun Hat 88.4
Person 85.2
People 83.9
Hat 79.6
Hat 71.6
Cowboy Hat 69.2
Art 61.8
Painting 61.8
Family 55.3

Imagga
created on 2022-06-25

stucco 65.5
column 61.3
sculpture 52
architecture 38.9
marble 34.4
statue 34.4
ancient 32.9
monument 31.8
old 30
stone 29.6
history 26.8
art 25
building 23.9
landmark 22.6
travel 22.5
famous 22.3
tourism 22.3
historic 21.1
antique 19.8
culture 19.7
historical 16.9
religion 16.1
temple 15.5
god 15.3
city 15
carving 14.7
tourist 14.5
vintage 14.1
roman 12.1
texture 11.8
detail 11.3
facade 10.9
decoration 10.9
wall 10.8
fountain 10.1
statues 9.9
grunge 9.4
church 9.3
rough 9.1
mythology 8.9
ruins 8.8
exterior 8.3
brown 8.1
arch 8
structure 7.8
baroque 7.8
catholic 7.8
heritage 7.7
holy 7.7
architectural 7.7
cathedral 7.7
wallpaper 7.7
panel 7.6
ornamental 7.6
pattern 7.5
corbel 7.5
support 7.4
symbol 7.4
design 7.3
national 7.3
memorial 7.2
material 7.1
ruler 7.1
interior 7.1

Google
created on 2022-06-25

Hat 92.3
Sun hat 88.1
Headgear 83.5
Suit 80.7
Vintage clothing 76.7
Cowboy hat 73.9
Fedora 68.9
Monochrome 67.9
Classic 67.4
Collar 67
History 66
Uniform 64
Art 63.6
Room 63.3
Paper product 59.3
Picture frame 55.2
Retro style 53.5
Visual arts 53
Antique 52.3
Collection 51.2

Microsoft
created on 2022-06-25

old 98.3
clothing 96.6
hat 96.6
person 93.2
building 88.4
human face 84.7
fashion accessory 79.1
smile 75.4
white 69.9
black 67.1
vintage clothing 59.3
fedora 54.3
posing 54.1
cowboy hat 54
sculpture 49.6
vintage 38.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 100%
Calm 70.4%
Sad 23.9%
Surprised 6.9%
Fear 6.4%
Angry 3%
Confused 2.1%
Happy 1.9%
Disgusted 1.5%

AWS Rekognition

Age 35-43
Gender Female, 58.1%
Calm 93.7%
Surprised 6.4%
Fear 5.9%
Happy 3.7%
Sad 2.3%
Angry 0.8%
Confused 0.7%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 92.9%
Surprised 6.4%
Fear 6%
Calm 4.6%
Sad 2.5%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 2-8
Gender Female, 94.6%
Happy 70.8%
Calm 18.9%
Surprised 6.4%
Fear 6.1%
Sad 5.4%
Confused 1.5%
Angry 0.8%
Disgusted 0.5%

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 90.4%
Painting 61.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.7%
a vintage photo of a group of people posing for a picture 93.6%
an old photo of a group of people posing for the camera 93.5%

Text analysis

Amazon

Sm22

Google

dru22