Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: Women's Detained Room: Writing the First Letter Home.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.300.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: Women's Detained Room: Writing the First Letter Home.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Human 99.3
Person 99.3
Person 98.1
Person 97.9
Person 97.2
Clothing 94.3
Apparel 94.3
Person 93.3
Person 91.7
Painting 85.4
Art 85.4
Person 84.3
People 80.2
Sitting 76.5
Person 71.4
Building 66.8
Table 57.9
Furniture 57.9

Imagga
created on 2022-06-04

home 31.1
grandfather 29.6
old 24.4
interior 23
chair 22.4
furniture 21.7
room 20.9
hospital 19.1
person 18.6
indoors 18.4
man 18.1
people 16.2
barbershop 15.7
architecture 15.6
sitting 15.5
house 14.2
male 14.2
ancient 13.8
smiling 13.7
shop 13.2
senior 13.1
adult 13.1
portrait 12.9
indoor 12.8
sculpture 12.3
historical 12.2
happy 11.9
vintage 11.6
lifestyle 11.6
table 11.2
mature 11.2
inside 11
decoration 10.9
upright 10.7
art 10.7
family 10.7
bed 10.6
seat 10.5
mercantile establishment 10.4
grandma 10.4
wall 10.3
antique 10.1
armchair 10.1
retired 9.7
child 9.6
design 9.6
statue 9.5
luxury 9.4
monument 9.3
window 9.3
face 9.2
building 9.2
travel 9.1
retro 9
style 8.9
couple 8.7
love 8.7
lamp 8.7
elderly 8.6
comfortable 8.6
smile 8.5
bedroom 8.4
wood 8.3
historic 8.2
lady 8.1
history 8
light 8
fireplace 8
barber chair 8
mother 7.7
culture 7.7
retirement 7.7
city 7.5
one 7.5
piano 7.4
cheerful 7.3
alone 7.3
dress 7.2
kid 7.1
place of business 7.1
happiness 7.1
furnishing 7

Google
created on 2022-06-04

Photograph 94.1
Furniture 93.5
Table 90.2
Black 89.6
Coat 87.1
Standing 86.4
Dress 83.8
People 77.7
Vintage clothing 75.8
Suit 75.4
Snapshot 74.3
Desk 73.1
Room 70.1
Sitting 69.6
Event 68
Stock photography 66.5
Art 64.6
History 63.8
Chair 63.8
Monochrome 58.6

Microsoft
created on 2022-06-04

text 99.2
clothing 98
person 94.8
indoor 88
smile 86.1
woman 82.9
furniture 82.3
table 81.2
human face 78.8
man 62.1
old 44.2
family 29.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 74.5%
Calm 67.2%
Angry 8.4%
Fear 8.2%
Surprised 8.1%
Sad 4.7%
Disgusted 4.2%
Confused 3.1%
Happy 2.8%

AWS Rekognition

Age 40-48
Gender Female, 71%
Sad 98%
Calm 42.1%
Surprised 6.5%
Fear 6.2%
Confused 1.1%
Angry 0.7%
Disgusted 0.6%
Happy 0.3%

AWS Rekognition

Age 7-17
Gender Male, 89.1%
Calm 96.7%
Surprised 6.3%
Fear 5.9%
Sad 3.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 33-41
Gender Female, 98.6%
Sad 100%
Calm 9.2%
Surprised 6.3%
Fear 6.1%
Angry 1.1%
Disgusted 0.4%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Male, 90%
Calm 89.1%
Surprised 6.5%
Fear 6.1%
Sad 4%
Confused 2.7%
Angry 1.7%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 51-59
Gender Female, 100%
Calm 88.7%
Surprised 6.8%
Fear 6.6%
Confused 4.6%
Sad 2.4%
Angry 1.5%
Disgusted 0.8%
Happy 0.5%

AWS Rekognition

Age 30-40
Gender Male, 93.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 4.6%
Angry 0.5%
Confused 0.4%
Disgusted 0.2%
Happy 0%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 85.6%
Disgusted 7.8%
Surprised 6.8%
Fear 6%
Angry 2.6%
Sad 2.5%
Confused 1.2%
Happy 0.5%

AWS Rekognition

Age 24-34
Gender Female, 55.9%
Calm 58.5%
Happy 16.9%
Sad 8.4%
Surprised 8%
Fear 6.8%
Angry 6.3%
Confused 1.9%
Disgusted 1%

AWS Rekognition

Age 18-24
Gender Female, 90.9%
Surprised 99.3%
Fear 6.6%
Calm 3.4%
Sad 2.6%
Happy 1.9%
Disgusted 0.9%
Confused 0.7%
Angry 0.5%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.3%
Painting 85.4%

Captions

Microsoft

a group of people sitting at a table 91.7%
a group of people sitting around a table 91.6%
a group of people sitting on a table 86.7%

Text analysis

Amazon

FIRST
THE
DETAINED
WOMENS
WOMENS DETAINED DOOM:WRITING THE FIRST LETTERHOME
LETTERHOME
DOOM:WRITING

Google

WRITING
.
DETAINED
:
THE
WOMENS
ROOM
LETTER
FIRST
HOME
WOMENS DETAINED ROOM:WRITING THE FIRST LETTER HOME.