Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry, United States Immigrant Station, New York City: Group of Those to Be Deported.

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.24.1

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry, United States Immigrant Station, New York City: Group of Those to Be Deported.

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.24.1

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.1
Human 99.1
Person 98.9
Person 98.9
Person 98.5
Person 98.2
Person 97.3
Person 96.2
Person 95.9
Person 95.5
Person 93.2
Person 92.6
Person 90.1
People 89.6
Room 85.5
Indoors 85.5
Person 84.6
Couch 81.9
Furniture 81.9
Living Room 77.3
Person 75.7
Art 74.3
Painting 74.3
Person 73
Person 71.5
Person 67.8
Kindergarten 61
Person 49.6

Imagga
created on 2022-06-25

kin 28.6
person 18.7
old 18.1
people 17.3
world 16
man 15.6
antique 14.9
ancient 14.7
dress 13.5
child 12.6
interior 12.4
statue 12.4
room 12.4
stone 11.9
religion 11.6
vintage 11.6
holiday 11.5
musical instrument 11.4
decoration 11.4
lady 10.5
bride 10.5
couple 10.4
home 10.4
portrait 10.3
culture 10.2
happy 10
retro 9.8
family 9.8
happiness 9.4
male 9.3
wedding 9.2
travel 9.1
traditional 9.1
dirty 9
sculpture 9
art 8.7
love 8.7
scene 8.6
face 8.5
adult 8.5
monument 8.4
groom 8.4
girls 8.2
architecture 7.8
sepia 7.8
fashion 7.5
house 7.5
tradition 7.4
aged 7.2
mother 7.2

Google
created on 2022-06-25

Photograph 94.2
White 92.2
Black 89.9
Style 83.8
Headgear 81.7
Crew 77.8
Hat 76.8
Vintage clothing 75.4
Event 73.6
Monochrome 72.6
Team 70.4
Fun 68.2
Crowd 68.1
Room 66.3
History 64.8
Monochrome photography 63.6
Stock photography 61.7
Uniform 56.1
Suit 55.6
Family 52.4

Microsoft
created on 2022-06-25

person 99.8
clothing 99
human face 94.7
group 88.8
man 88
indoor 88
old 87.2
smile 79.8
child 64.8
posing 43.3
crowd 1.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Male, 99.8%
Calm 96.8%
Surprised 6.3%
Fear 5.9%
Angry 2.3%
Sad 2.2%
Confused 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Angry 48.2%
Calm 43.5%
Surprised 6.9%
Fear 6.2%
Confused 2.9%
Sad 2.4%
Disgusted 1.6%
Happy 0.8%

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 99.2%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 30-40
Gender Female, 99.7%
Calm 89.6%
Surprised 6.7%
Fear 6.2%
Angry 4.4%
Sad 3.1%
Disgusted 1%
Confused 0.5%
Happy 0.2%

AWS Rekognition

Age 38-46
Gender Male, 81.8%
Calm 78%
Disgusted 13.3%
Surprised 6.6%
Fear 6.4%
Angry 4.3%
Sad 2.5%
Confused 0.7%
Happy 0.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 97.7%
Surprised 6.6%
Fear 6%
Sad 2.2%
Angry 0.6%
Confused 0.5%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Male, 99.9%
Angry 97%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 1.2%
Calm 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 2-10
Gender Female, 59.3%
Happy 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 6-12
Gender Female, 97.2%
Angry 93.7%
Surprised 6.5%
Fear 6.2%
Calm 2.5%
Sad 2.4%
Happy 1.1%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Female, 77.5%
Angry 61.8%
Surprised 20.1%
Calm 14.5%
Fear 7.6%
Sad 3.1%
Disgusted 0.6%
Happy 0.6%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Female, 99.6%
Confused 35.8%
Calm 22.3%
Happy 20.6%
Surprised 9.6%
Fear 8%
Angry 4.9%
Sad 3.7%
Disgusted 1.8%

AWS Rekognition

Age 45-53
Gender Male, 58.3%
Calm 90.3%
Surprised 6.9%
Fear 6.1%
Sad 4.4%
Confused 0.8%
Angry 0.7%
Happy 0.6%
Disgusted 0.5%

AWS Rekognition

Age 4-10
Gender Female, 99.9%
Calm 78.6%
Sad 12.5%
Fear 6.7%
Surprised 6.7%
Angry 2.1%
Disgusted 1.5%
Confused 1%
Happy 0.7%

AWS Rekognition

Age 0-6
Gender Female, 72.6%
Sad 81.3%
Angry 35.9%
Calm 14.1%
Surprised 7.6%
Fear 7.4%
Confused 3.7%
Disgusted 2.3%
Happy 0.8%

AWS Rekognition

Age 45-53
Gender Female, 78.2%
Calm 76.3%
Angry 15.8%
Surprised 6.6%
Fear 6%
Confused 5%
Sad 2.4%
Happy 0.8%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Male, 77.8%
Angry 71.6%
Calm 17.4%
Surprised 6.8%
Fear 6.3%
Confused 3.7%
Sad 3.2%
Disgusted 2%
Happy 0.4%

AWS Rekognition

Age 16-24
Gender Male, 96.6%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 2-8
Gender Male, 50.4%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 6-12
Gender Female, 80.8%
Calm 64.7%
Angry 31.3%
Surprised 6.7%
Fear 6.1%
Sad 2.4%
Confused 1.1%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 42-50
Gender Male, 93.9%
Calm 56.5%
Angry 19.6%
Sad 8.6%
Surprised 7%
Disgusted 7%
Fear 6.4%
Confused 3.2%
Happy 0.7%

AWS Rekognition

Age 0-3
Gender Male, 99.1%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 2-8
Gender Female, 58.8%
Calm 93.9%
Surprised 6.8%
Fear 6.5%
Sad 2.5%
Disgusted 1.3%
Confused 0.6%
Happy 0.3%
Angry 0.3%

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 74.3%

Categories

Imagga

people portraits 87.5%
events parties 12.1%

Text analysis

Amazon

Im
Im 25
25

Google

Im 25
Im
25