Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City. New York Detained Group: Men at Dinner

Date

c. 1903

People

Artist: J. H. Adams, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.224.2

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City. New York Detained Group: Men at Dinner

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Human 99.7
Person 99.7
Person 99.6
Person 99.4
Person 99
Person 98.3
Person 97.8
Person 97.7
Clothing 95.4
Apparel 95.4
Person 95.2
Pottery 92.1
Bowl 90.6
Person 90.3
People 79.7
Meal 76.5
Food 76.5
Dish 74
Person 71.7
Person 70.6
Hat 69.5
Saucer 67.2
Person 66.8
Person 61.5
Person 61.2
Person 60.7
Person 59.5
Face 59.4
Pot 58.1
Coat 57.4
Overcoat 57.4
Person 51
Person 44.6

Imagga
created on 2022-06-25

banjo 57
stringed instrument 48.9
musical instrument 42.3
kin 21.2
room 20.7
man 18.1
person 16.8
old 15.3
people 14.5
interior 14.1
architecture 14
toilet 13.9
wall 12.8
decoration 12.4
male 11.3
couple 11.3
art 11.3
table 10.4
luxury 10.3
adult 10
grandfather 9.7
black 9.6
bride 9.6
home 9.6
statue 9.5
love 9.5
party 9.4
elegance 9.2
vintage 9.1
fashion 9
dress 9
retro 9
history 8.9
building 8.8
antique 8.8
ancient 8.6
men 8.6
historical 8.5
traditional 8.3
wedding 8.3
style 8.2
lady 8.1
celebration 8
sculpture 8
indoors 7.9
flowers 7.8
world 7.8
culture 7.7
grunge 7.7
dining 7.6
happy 7.5
monument 7.5
groom 7.3
historic 7.3
dirty 7.2
sexy 7.2
religion 7.2
holiday 7.2
portrait 7.1
happiness 7

Google
created on 2022-06-25

Photograph 94.1
Human 89.4
Coat 87.1
Style 83.9
Black-and-white 83.7
Headgear 81.7
Crowd 77.4
Monochrome 77.2
Vintage clothing 76.9
Mixing bowl 76.7
Fun 76.7
Monochrome photography 76
Hat 76
Suit 75.8
Snapshot 74.3
Crew 73.5
Event 73.3
Room 65.7
History 64.9
Formal wear 63.3

Microsoft
created on 2022-06-25

person 99.9
clothing 98.4
group 93.4
man 92.2
old 90.2
people 82.8
posing 79.2
human face 71.2
smile 71
black 70.7
text 67.6
crowd 2.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 94.5%
Fear 6.6%
Surprised 6.4%
Sad 2.2%
Confused 2.2%
Angry 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Female, 63%
Angry 89%
Surprised 6.8%
Fear 6.1%
Calm 4.1%
Sad 2.7%
Confused 2.4%
Disgusted 0.9%
Happy 0.3%

AWS Rekognition

Age 20-28
Gender Male, 98.6%
Calm 86.5%
Fear 8.2%
Surprised 6.9%
Sad 3.4%
Angry 2%
Happy 0.7%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.6%
Calm 71.2%
Surprised 13.3%
Angry 6.9%
Fear 6.1%
Confused 5.7%
Sad 2.9%
Disgusted 2.5%
Happy 1.4%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Angry 79.1%
Calm 13.6%
Surprised 6.7%
Fear 6.1%
Confused 2.8%
Sad 2.6%
Disgusted 1.4%
Happy 0.4%

AWS Rekognition

Age 35-43
Gender Male, 91.4%
Calm 70.3%
Confused 22%
Surprised 6.6%
Fear 6.1%
Sad 2.3%
Disgusted 2.3%
Happy 2.1%
Angry 1.6%

AWS Rekognition

Age 18-26
Gender Male, 99.2%
Calm 82%
Confused 12.1%
Surprised 8.9%
Fear 6.1%
Sad 2.2%
Angry 0.4%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.6%
Disgusted 0.1%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 99.8%
Calm 48.7%
Angry 18.8%
Sad 13.4%
Surprised 9.5%
Fear 6.8%
Happy 5.9%
Confused 3.6%
Disgusted 1.8%

AWS Rekognition

Age 22-30
Gender Female, 92.8%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.8%
Angry 0.3%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 40-48
Gender Male, 98.8%
Calm 82.2%
Fear 7.2%
Surprised 7.2%
Sad 6.5%
Confused 1.5%
Angry 1.4%
Disgusted 1.3%
Happy 0.6%

AWS Rekognition

Age 18-24
Gender Male, 99.2%
Confused 41.8%
Calm 33.9%
Sad 13.2%
Fear 7.6%
Surprised 6.8%
Disgusted 2.2%
Happy 1.9%
Angry 1.4%

AWS Rekognition

Age 23-31
Gender Male, 83.1%
Calm 49.5%
Disgusted 22.6%
Sad 9.1%
Surprised 8.2%
Fear 6.9%
Angry 4.7%
Confused 3.7%
Happy 3%

AWS Rekognition

Age 18-26
Gender Female, 83.2%
Surprised 74.9%
Calm 21.6%
Happy 18.7%
Fear 8.1%
Angry 6.6%
Sad 2.6%
Disgusted 2%
Confused 0.6%

AWS Rekognition

Age 16-24
Gender Male, 89.2%
Calm 82.3%
Happy 10.2%
Surprised 7%
Fear 6.2%
Sad 2.7%
Angry 2%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 20-28
Gender Female, 73.2%
Calm 61.8%
Fear 15.2%
Surprised 8.6%
Sad 7.1%
Happy 4.7%
Angry 2%
Confused 2%
Disgusted 1%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 98.8%
an old photo of a group of people posing for the camera 98.5%
an old photo of a group of people posing for a picture 98.4%

Text analysis

Amazon

Im
Im 8
8