Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: New York detained; awaiting arrival of friends.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2393.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City: New York detained; awaiting arrival of friends.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2393.2

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Human 99.3
Person 99.3
Person 98.9
Person 98.7
Person 98.3
Audience 98.3
Crowd 98.3
Person 98.1
Person 97.8
Person 97.6
Person 96.8
Person 96.8
Person 95.9
Person 94.5
Person 92.5
Person 86.8
Person 85.6
Person 85.5
Person 84.3
Person 79.3
Person 77.9
Clothing 77
Apparel 77
Room 75.8
Indoors 75.8
People 73.9
Person 71.6
Table 68.3
Furniture 68.3
Pub 68.1
Bar Counter 68.1
Person 67.2
Hat 64.8
Meal 62.5
Food 62.5
Workshop 62
Person 59.5
Sitting 58.7
Restaurant 58.4
Speech 56
Chair 56

Clarifai
created on 2019-06-04

people 99.9
many 99.7
group 99.5
group together 99.1
adult 96.9
administration 96.4
leader 96
military 94
man 93.5
wear 93.4
several 93.1
war 89.8
offense 88
woman 87.3
crowd 84.3
outfit 83.5
uniform 78.7
vehicle 78.4
police 76.3
chair 73.5

Imagga
created on 2019-06-04

metropolitan 54.4
religion 26
old 20.9
church 20.3
architecture 18.7
couple 17.4
catholic 17.1
religious 16.9
people 16.2
interior 15
god 14.3
home 13.5
cathedral 13.4
statue 13.3
person 13.1
monument 13.1
sculpture 12.9
love 12.6
worship 12.6
building 12.2
travel 12
culture 12
historic 11.9
fan 11.8
altar 11.7
traditional 11.6
holy 11.5
holiday 11.5
indoors 11.4
historical 11.3
table 11.2
ancient 11.2
celebration 11.2
room 11.1
man 10.9
groom 10.9
city 10.8
gold 10.7
pray 10.7
new 10.5
sitting 10.3
men 10.3
decoration 10.1
wedding 10.1
glass 10.1
male 9.9
history 9.8
prayer 9.6
restaurant 9.6
follower 9.5
party 9.4
wall 9.4
stone 9.3
art 9.3
tradition 9.2
hall 9.1
adult 9.1
cheerful 8.9
family 8.9
temple 8.7
women 8.7
spiritual 8.6
bride 8.6
happiness 8.6
two 8.5
famous 8.4
wine 8.3
tourism 8.2
indoor 8.2
happy 8.1
dress 8.1
ruler 7.8
arch 7.8
marble 7.7
life 7.7
drink 7.5
place 7.4
antique 7.2
tourist 7.2
landmark 7.2

Google
created on 2019-06-04

People 93.1
Social group 91.9
Crowd 77.6
Event 71.1
Team 52.3
Family 51.8

Microsoft
created on 2019-06-04

person 100
clothing 99.4
group 97.5
human face 96.2
smile 94.4
posing 94.1
man 92.3
old 88.6
standing 79.6
black 66.5
woman 64.8
white 61.6
photograph 58
team 51.1
dressed 32.3
clothes 20.9
crowd 3.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 81%
Confused 2%
Angry 2%
Happy 0.3%
Sad 90.9%
Disgusted 0.6%
Surprised 0.6%
Calm 3.5%

AWS Rekognition

Age 26-43
Gender Male, 73.4%
Confused 11.1%
Sad 7.3%
Disgusted 9.4%
Surprised 17.2%
Angry 9.6%
Happy 5.2%
Calm 40.1%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Surprised 45.1%
Confused 45.2%
Happy 45.1%
Angry 45.3%
Disgusted 45.1%
Sad 50.9%
Calm 48.4%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Calm 46.7%
Sad 52.7%
Surprised 45.1%
Confused 45.2%
Angry 45.2%
Disgusted 45.1%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Confused 45.4%
Surprised 45.3%
Happy 47.3%
Disgusted 45.3%
Calm 51.1%
Sad 45.2%
Angry 45.4%

AWS Rekognition

Age 6-13
Gender Female, 52.4%
Angry 47.6%
Happy 45.6%
Disgusted 45.5%
Surprised 45.2%
Calm 47.5%
Confused 45.6%
Sad 48%

AWS Rekognition

Age 15-25
Gender Male, 51.4%
Disgusted 45.1%
Happy 45%
Sad 48.5%
Angry 45.5%
Calm 49.7%
Confused 45.8%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Male, 99.3%
Sad 5.2%
Confused 11.5%
Angry 8.5%
Surprised 3.5%
Happy 1.8%
Calm 67.7%
Disgusted 1.8%

AWS Rekognition

Age 27-44
Gender Male, 54.9%
Confused 45.2%
Sad 52.2%
Surprised 45%
Happy 45.1%
Angry 45.1%
Disgusted 45.1%
Calm 47.2%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Calm 48.5%
Happy 45.1%
Surprised 45%
Sad 50.5%
Angry 45.4%
Disgusted 45.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 55%
Confused 45.3%
Disgusted 45.2%
Sad 45.2%
Surprised 45.4%
Calm 48.7%
Happy 50%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Sad 51.2%
Disgusted 45.1%
Confused 45.3%
Calm 47.5%
Happy 45.5%
Surprised 45.1%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54%
Calm 52.4%
Disgusted 45.3%
Surprised 45.2%
Sad 46.2%
Happy 45.1%
Angry 45.3%
Confused 45.4%

AWS Rekognition

Age 38-57
Gender Female, 54.7%
Disgusted 45.9%
Surprised 45.6%
Confused 46.1%
Sad 49.1%
Calm 46.8%
Angry 45.7%
Happy 45.8%

AWS Rekognition

Age 26-43
Gender Male, 64.9%
Disgusted 4.8%
Confused 1.5%
Happy 0.6%
Calm 82%
Surprised 1.7%
Sad 4.1%
Angry 5.4%

AWS Rekognition

Age 20-38
Gender Male, 55%
Sad 45.6%
Disgusted 45.1%
Calm 53.4%
Surprised 45.1%
Happy 45.1%
Angry 45.3%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54%
Angry 45.2%
Happy 47.6%
Disgusted 45.2%
Surprised 45.2%
Calm 45.6%
Confused 45.1%
Sad 51.1%

AWS Rekognition

Age 20-38
Gender Male, 53.4%
Calm 45.2%
Happy 47.5%
Confused 45.1%
Angry 45.2%
Disgusted 45.2%
Surprised 45.3%
Sad 51.5%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Calm 50.1%
Sad 46.8%
Confused 45.3%
Happy 45.1%
Angry 47.2%
Surprised 45.1%
Disgusted 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Angry 45.5%
Sad 47%
Disgusted 46.3%
Calm 46.5%
Happy 48.9%
Surprised 45.5%
Confused 45.3%

AWS Rekognition

Age 38-59
Gender Male, 53.7%
Surprised 45.3%
Sad 46.4%
Happy 45.3%
Disgusted 45.3%
Confused 45.2%
Calm 45.6%
Angry 52%

AWS Rekognition

Age 35-52
Gender Female, 50%
Disgusted 49.9%
Happy 49.6%
Calm 49.7%
Angry 49.5%
Confused 49.5%
Sad 49.7%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Happy 45.1%
Angry 49%
Confused 45.1%
Calm 49.7%
Sad 45.2%
Disgusted 45.9%
Surprised 45.1%

AWS Rekognition

Age 15-25
Gender Female, 51.6%
Angry 45.2%
Sad 54.5%
Disgusted 45.1%
Happy 45.1%
Calm 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 35-52
Gender Male, 52%
Sad 45.3%
Happy 46%
Angry 45.4%
Calm 50.9%
Surprised 45.4%
Confused 45.3%
Disgusted 46.6%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Calm 45.5%
Disgusted 45.2%
Confused 45.2%
Happy 45.1%
Angry 45.2%
Surprised 45.1%
Sad 53.7%

AWS Rekognition

Age 26-43
Gender Male, 51.3%
Surprised 45.4%
Angry 47.3%
Calm 45.3%
Confused 45.4%
Disgusted 45.4%
Happy 45.1%
Sad 51.1%

AWS Rekognition

Age 38-59
Gender Female, 54%
Calm 45.2%
Happy 52.6%
Sad 45.6%
Surprised 45.4%
Disgusted 45.7%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 45.7%
Sad 49.1%
Calm 49.5%
Happy 45.2%
Confused 45.2%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 38-59
Gender Male, 51.5%
Confused 45.5%
Disgusted 45.7%
Sad 49%
Surprised 45.3%
Calm 45.3%
Happy 47.9%
Angry 46.4%

AWS Rekognition

Age 35-52
Gender Female, 53.1%
Calm 45.2%
Sad 45.2%
Angry 45%
Disgusted 45%
Confused 45%
Happy 54.5%
Surprised 45%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Surprised 49.5%
Confused 49.5%
Sad 49.9%
Disgusted 49.7%
Calm 49.6%
Angry 49.6%
Happy 49.6%

AWS Rekognition

Age 35-52
Gender Male, 53.9%
Surprised 45.3%
Confused 45.2%
Angry 45.5%
Disgusted 46.2%
Sad 48.8%
Happy 47%
Calm 47%

AWS Rekognition

Age 30-47
Gender Female, 50.5%
Angry 49.7%
Surprised 49.5%
Calm 49.5%
Sad 50.1%
Happy 49.6%
Disgusted 49.6%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 53.3%
Disgusted 48.6%
Surprised 45.4%
Confused 45.3%
Sad 45.7%
Angry 46.4%
Calm 48.1%
Happy 45.5%

AWS Rekognition

Age 27-44
Gender Female, 50.4%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.6%
Confused 49.5%
Sad 50.2%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Happy 45.2%
Angry 45.6%
Calm 51.9%
Disgusted 45.2%
Sad 46.6%
Confused 45.3%
Surprised 45.1%

AWS Rekognition

Age 48-68
Gender Female, 50%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%
Sad 50.2%
Happy 49.5%
Calm 49.6%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.3%
Calm 49.6%
Angry 49.7%
Happy 49.5%
Sad 50.1%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 51.1%
Confused 45.1%
Calm 45.7%
Disgusted 45.1%
Happy 45.4%
Angry 45.2%
Sad 53.4%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.8%
Confused 45.2%
Sad 45.4%
Angry 45.4%
Happy 46.7%
Disgusted 45.8%
Surprised 46.8%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 64.8%

Categories

Imagga

people portraits 97.4%
events parties 1.9%

Text analysis

Amazon

12
I9m721 12
I9m721