Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigration Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: On the Railroad Floor. These Immigrants Have Been Admitted And Are Waiting to Depart To Their Several Destinations.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.458.1

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigration Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: On the Railroad Floor. These Immigrants Have Been Admitted And Are Waiting to Depart To Their Several Destinations.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.3
Human 99.3
Person 99
Person 98.4
Person 98.2
Person 98
Person 97.6
Apparel 97
Clothing 97
Person 95.7
Person 95.5
Person 94.9
Person 90.1
Person 88.1
Person 81.7
Person 80.1
Crowd 78
People 73.5
Person 72.7
Female 66.4
Building 61.8
Person 61.4
Coat 61
Overcoat 61
Outdoors 56.7

Clarifai
created on 2019-06-05

people 99.9
group 99.6
many 99.1
group together 98.4
adult 96.5
wear 96
administration 94.3
woman 93.9
man 93.1
leader 91.9
several 90.6
queue 89
military 86.4
outfit 84.6
crowd 84.5
war 80.7
five 80.4
ceremony 80.2
child 77.6
education 74.4

Imagga
created on 2019-06-05

boutique 23.9
outfit 20.5
people 15
adult 13.5
person 12.6
interior 12.4
clothing 12.1
old 11.8
group 11.3
room 11
business 10.9
dress 10.8
travel 10.5
architecture 10.1
man 10.1
traditional 10
fashion 9.8
black 9.6
home 9.6
store 9.4
uniform 9.2
marimba 8.9
women 8.7
scene 8.6
men 8.6
percussion instrument 8.5
clothes 8.4
house 8.3
human 8.2
indoor 8.2
musical instrument 8.2
building 8.1
table 7.8
glass 7.8
modern 7.7
culture 7.7
casual 7.6
shop 7.6
tourism 7.4
window 7.3
jacket 7.2
work 7.1
teacher 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

person 96.1
clothing 95.9
old 93.1
group 75.3
smile 63.2
clothes 15.3
sale 8.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Calm 53%
Disgusted 45.2%
Angry 45.3%
Happy 45.1%
Sad 46.2%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 45-65
Gender Male, 54.8%
Calm 49.6%
Disgusted 45.2%
Surprised 47.2%
Angry 45.3%
Sad 45.3%
Confused 45.4%
Happy 47%

AWS Rekognition

Age 26-43
Gender Male, 53.2%
Disgusted 45.2%
Confused 45.3%
Surprised 46.5%
Calm 52%
Happy 45.2%
Angry 45.5%
Sad 45.3%

AWS Rekognition

Age 20-38
Gender Male, 54.6%
Confused 45.2%
Calm 53.8%
Disgusted 45.1%
Sad 45.4%
Happy 45.1%
Angry 45.1%
Surprised 45.2%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Happy 45.1%
Angry 45.1%
Calm 54.4%
Sad 45.1%
Surprised 45.2%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.8%
Disgusted 45.1%
Happy 45.1%
Angry 45.1%
Calm 45.1%
Surprised 45%
Confused 45.1%
Sad 54.6%

AWS Rekognition

Age 27-44
Gender Male, 54.8%
Happy 45.3%
Angry 45.5%
Calm 50%
Sad 47.8%
Surprised 45.3%
Confused 45.7%
Disgusted 45.3%

AWS Rekognition

Age 45-66
Gender Female, 50%
Surprised 45%
Sad 54.6%
Disgusted 45%
Calm 45.2%
Happy 45%
Angry 45%
Confused 45%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Angry 45.2%
Calm 51.6%
Surprised 45.3%
Sad 47.1%
Disgusted 45.4%
Happy 45.3%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 45%
Happy 54.7%
Angry 45%
Calm 45.1%
Surprised 45%
Confused 45%
Sad 45%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Sad 50.9%
Calm 46.4%
Surprised 45.1%
Confused 45.2%
Disgusted 45.5%
Happy 45.1%
Angry 46.8%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Angry 45.3%
Sad 49.2%
Disgusted 45.1%
Calm 47.8%
Surprised 45.2%
Confused 45.3%
Happy 47.1%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Calm 53.6%
Disgusted 45.2%
Surprised 45.1%
Confused 45.1%
Angry 45.3%
Sad 45.6%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Disgusted 45.2%
Confused 45.8%
Happy 45.2%
Calm 50.1%
Surprised 45.4%
Sad 47.6%
Angry 45.6%

AWS Rekognition

Age 45-63
Gender Male, 53.2%
Angry 46.1%
Disgusted 46.1%
Calm 48.2%
Surprised 45.5%
Happy 45.2%
Sad 48.6%
Confused 45.3%

AWS Rekognition

Age 20-38
Gender Male, 53.6%
Surprised 45.4%
Happy 45.3%
Confused 45.3%
Calm 49.9%
Disgusted 45.4%
Angry 46.6%
Sad 47.1%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Angry 45.5%
Surprised 45.9%
Disgusted 46.3%
Sad 46%
Happy 45.3%
Confused 45.7%
Calm 50.3%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Disgusted 45.2%
Confused 45.5%
Surprised 45.3%
Calm 49.2%
Happy 45.2%
Angry 45.7%
Sad 48.9%

AWS Rekognition

Age 26-43
Gender Female, 52%
Calm 46.7%
Surprised 45.2%
Happy 45.2%
Angry 48.9%
Confused 45.1%
Sad 45.4%
Disgusted 48.5%

AWS Rekognition

Age 45-65
Gender Male, 54%
Calm 46.5%
Surprised 45.1%
Confused 45.4%
Sad 45.2%
Angry 45.8%
Disgusted 51.8%
Happy 45.2%

AWS Rekognition

Age 20-38
Gender Male, 53.7%
Surprised 45.6%
Disgusted 45.6%
Angry 45.7%
Sad 50.9%
Happy 45.8%
Confused 45.4%
Calm 46%

AWS Rekognition

Age 45-65
Gender Female, 50.1%
Angry 45.6%
Confused 45.6%
Calm 47.4%
Surprised 45.7%
Sad 48.1%
Happy 46.8%
Disgusted 45.7%

AWS Rekognition

Age 27-44
Gender Male, 53%
Surprised 45.2%
Angry 45.4%
Sad 53.5%
Happy 45.1%
Disgusted 45.1%
Calm 45.6%
Confused 45.2%

AWS Rekognition

Age 38-57
Gender Female, 50.7%
Confused 45.2%
Angry 45.6%
Disgusted 46.1%
Calm 45.9%
Happy 45.4%
Surprised 45.2%
Sad 51.7%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a vintage photo of a group of people standing in front of a store 81%
a vintage photo of a group of people standing in a room 80.9%
a vintage photo of a group of people posing for the camera 80.8%

Text analysis

Amazon

HAVE
ADMITTED
RAILROAD
SEVERAL
WAITING
AND
THESE
JMMIGRANTS
O DEPAR'T
SEVERAL DESTINATIONS. THEIR
Q THE RAILROAD FLOOR THESE JMMIGRANTS HAVE BEEN ADMITTED AND ARE WAITING TO O DEPAR'T TO
BEEN
FLOOR
THEIR
THE
DESTINATIONS.
Q
TO
ARE

Google

OM
THE
RAILROAD
BEEN
TO
PE OM THE RAILROAD FLOOR THESE JMMIGRANTS HAVE BEEN ADMITTED AND ARE WAITING TO DEPART TO THEIR SEVERAL DESTINATIONS
PE
HAVE
DEPART
DESTINATIONS
FLOOR
THESE
ADMITTED
ARE
SEVERAL
AND
WAITING
JMMIGRANTS
THEIR