Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: Ellis Island Station.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2371.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: Ellis Island Station.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2371.2

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Human 99.1
Person 99.1
Person 98.9
Person 98.6
Clothing 98.4
Apparel 98.4
Person 98.2
Person 97.9
Person 95.7
Person 94.4
Person 94
Person 92.8
Crowd 92.2
Person 89.9
Hat 87.4
Person 84.2
People 79.1
Person 75.4
Person 70.5
Face 70.3
Overcoat 67.9
Coat 67.9
Person 66.5
Audience 65.2
Suit 59.2
Cap 58.4
Building 57
Sailor Suit 56.7
Person 55.2

Clarifai
created on 2019-06-04

people 99.9
many 99.6
group 98.8
adult 97.5
wear 96.8
group together 96.7
leader 95.5
man 92.5
woman 92.4
ceremony 91.7
administration 91
several 88.6
religion 87.8
war 87.6
military 87.1
crowd 86.4
outfit 82.4
uniform 81.3
nun 79.4
queue 76.9

Imagga
created on 2019-06-04

metropolitan 31.2
people 22.9
couple 22.6
old 20.9
man 20.2
person 20.1
religion 19.7
adult 17.1
nurse 16.6
happy 15
love 15
male 14.9
home 14.4
ruler 14.2
church 13.9
men 13.7
room 13.3
senior 13.1
dress 12.6
traditional 12.5
god 12.4
religious 12.2
culture 12
women 11.9
two 11.9
monk 11.8
happiness 11.7
bride 11.5
hospital 11.3
tradition 11.1
husband 10.7
history 10.7
family 10.7
groom 10.6
indoors 10.5
elderly 10.5
scene 10.4
teacher 10.2
clothing 10.2
wedding 10.1
child 10
student 10
medical 9.7
together 9.6
life 9.6
temple 9.5
smiling 9.4
doctor 9.4
art 9.2
travel 9.2
tourism 9.1
care 9
kin 8.8
mother 8.8
patient 8.7
ceremony 8.7
ancient 8.6
married 8.6
faith 8.6
architecture 8.6
sitting 8.6
marriage 8.5
catholic 8.5
portrait 8.4
health 8.3
vintage 8.3
20s 8.2
indoor 8.2
girls 8.2
fan 8.1
cheerful 8.1
interior 8
professional 7.8
pray 7.8
holy 7.7
cathedral 7.7
statue 7.6
wife 7.6
human 7.5
gold 7.4
aged 7.2
holiday 7.2
enrollee 7.1
to 7.1

Google
created on 2019-06-04

Crowd 73.4
Event 67

Microsoft
created on 2019-06-04

person 100
clothing 98.7
outdoor 93.2
group 91.5
man 90.5
woman 88
people 86.1
white 78
standing 77.1
old 70.5
clothes 15.2
crowd 1.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Female, 54.6%
Calm 51.4%
Happy 45.2%
Angry 45.4%
Sad 45.7%
Surprised 45.7%
Confused 46.5%
Disgusted 45.1%

AWS Rekognition

Age 17-27
Gender Male, 53.8%
Disgusted 45.3%
Angry 45.3%
Sad 46.4%
Surprised 45.6%
Happy 47%
Calm 50.1%
Confused 45.3%

AWS Rekognition

Age 20-38
Gender Female, 53.6%
Disgusted 45.3%
Sad 46%
Calm 51.5%
Surprised 45.6%
Confused 45.4%
Angry 45.5%
Happy 45.6%

AWS Rekognition

Age 45-65
Gender Male, 53.2%
Angry 45.4%
Happy 45.1%
Disgusted 45.2%
Surprised 45.4%
Calm 52.7%
Confused 45.2%
Sad 46.1%

AWS Rekognition

Age 38-59
Gender Male, 54.6%
Angry 45.2%
Calm 45.1%
Disgusted 45.1%
Happy 45.2%
Surprised 45%
Sad 54.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 45.2%
Disgusted 45.4%
Calm 53.5%
Surprised 45.3%
Happy 45.1%
Angry 45.3%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.9%
Angry 45.3%
Sad 51.4%
Disgusted 45.9%
Calm 45.4%
Happy 46.7%
Surprised 45.1%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Angry 45.7%
Surprised 47.9%
Disgusted 45.3%
Happy 46.8%
Calm 47%
Sad 46.4%
Confused 46%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Sad 47.2%
Surprised 45.4%
Calm 50.2%
Happy 45.2%
Disgusted 45.3%
Confused 45.8%
Angry 45.8%

AWS Rekognition

Age 35-52
Gender Female, 50.9%
Angry 45.3%
Sad 45.5%
Disgusted 45.4%
Happy 45.1%
Calm 53.3%
Confused 45.2%
Surprised 45.3%

AWS Rekognition

Age 38-59
Gender Female, 54%
Angry 45.4%
Happy 45.4%
Disgusted 46.4%
Sad 52.2%
Confused 45.2%
Calm 45.2%
Surprised 45.2%

AWS Rekognition

Age 27-44
Gender Male, 54.7%
Calm 45.2%
Happy 45.2%
Sad 51.6%
Surprised 45.2%
Disgusted 45.3%
Angry 46.9%
Confused 45.7%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Angry 45.6%
Happy 45.4%
Disgusted 45.4%
Sad 46.8%
Confused 45.4%
Calm 51.1%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Confused 49.6%
Calm 49.5%
Angry 49.6%
Sad 50.1%
Happy 49.5%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 12-22
Gender Male, 50.2%
Sad 50.4%
Happy 49.5%
Calm 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Happy 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.4%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Calm 52%
Disgusted 45.5%
Confused 45.3%
Happy 45.3%
Angry 45.4%
Surprised 45.5%
Sad 46.1%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Confused 45.4%
Calm 46.2%
Disgusted 47.5%
Happy 45.4%
Angry 45.5%
Sad 49.9%
Surprised 45.1%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Confused 49.5%
Angry 49.5%
Calm 49.6%
Disgusted 49.5%
Sad 50.3%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Happy 49.5%
Disgusted 49.6%
Surprised 49.6%
Angry 49.6%
Calm 49.6%
Sad 50.1%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.5%
Confused 49.6%
Sad 49.9%
Calm 49.9%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 35-53
Gender Male, 52.3%
Sad 50.3%
Surprised 45.4%
Angry 47.3%
Disgusted 45.3%
Confused 45.2%
Happy 45.1%
Calm 46.3%

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 87.4%

Categories

Imagga

people portraits 68.4%
events parties 31.4%

Text analysis

Amazon

34
9m 34
9m