Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry, United States Immigrant Station, New York City: Excluded Men and Women, Paupers, Convicts, Etc.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.24.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry, United States Immigrant Station, New York City: Excluded Men and Women, Paupers, Convicts, Etc.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.24.2

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.2
Human 99.2
Person 99.1
Person 98.6
Person 98.2
Person 97.6
Person 97.1
Person 96.6
Person 95.7
Person 89.2
Painting 86.7
Art 86.7
Clothing 86
Apparel 86
People 74.3
Person 65.9
Face 62.7
Room 60.9
Indoors 60.9
Officer 56.6
Military 56.6
Military Uniform 56.6

Imagga
created on 2022-06-25

uniform 27.8
man 24.8
military uniform 21.4
person 21.3
people 21.2
groom 19.3
clothing 18.6
male 15.6
dress 14.4
adult 14.1
world 13.4
old 13.2
musical instrument 13.2
brass 13.1
wind instrument 12.9
men 12.9
black 11.4
teacher 11
couple 10.4
religion 9.9
fashion 9.8
bride 9.6
love 9.5
happiness 9.4
covering 9.4
religious 9.4
two 9.3
consumer goods 9.2
room 8.8
happy 8.8
women 8.7
life 8.4
wedding 8.3
vintage 8.3
protection 8.2
tourist 8.2
professional 8.1
lady 8.1
history 8
mask 8
business 7.9
holiday 7.9
architecture 7.8
wall 7.7
faith 7.7
educator 7.4
tradition 7.4
work 7.3
new 7.3
weapon 7.2
family 7.1
travel 7

Google
created on 2022-06-25

White 92.2
Hat 89.6
Headgear 81.9
Vintage clothing 77
Tints and shades 76.7
Suit 70.9
Crew 68.5
History 65.3
Classic 63.8
Room 61.9
Sun hat 60.1
Monochrome 57.2
Retro style 55.4

Microsoft
created on 2022-06-25

wall 99.7
clothing 99.1
person 96.8
indoor 90
woman 88.8
man 82
old 72.1
smile 71.6
dress 71.1
text 64.3
posing 44

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 99.8%
Calm 91.5%
Surprised 7.2%
Fear 6.4%
Sad 3%
Confused 1%
Disgusted 0.9%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 98.6%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 41-49
Gender Female, 90%
Calm 97.2%
Surprised 6.4%
Fear 6%
Sad 2.4%
Confused 0.7%
Angry 0.5%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 36-44
Gender Female, 99.8%
Confused 65.9%
Calm 21.3%
Surprised 8.2%
Fear 6.3%
Happy 5.2%
Sad 2.7%
Angry 0.9%
Disgusted 0.6%

AWS Rekognition

Age 37-45
Gender Female, 99.9%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.6%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 1.1%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 98.1%
Confused 44%
Calm 30.6%
Sad 15.8%
Surprised 8.2%
Fear 6.5%
Angry 2.3%
Disgusted 1.6%
Happy 1.6%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 75.7%
Sad 8.2%
Fear 8.1%
Surprised 6.8%
Happy 3.6%
Confused 2.7%
Disgusted 1.7%
Angry 0.3%

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 86.7%

Categories

Imagga

people portraits 87%
events parties 12.8%

Text analysis

Amazon

26
Im 26
Im