Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.459.4

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.1
Person 99.1
Person 98.5
Face 76.6
Text 73.6
Home Decor 59.9
Art 59.5
Nature 59.1
Apparel 57.5
Overcoat 57.5
Clothing 57.5
Coat 57.5
Steamer 56.2

Clarifai
created on 2019-06-05

people 99.9
adult 99.5
man 99.2
portrait 98.9
art 98.7
painting 98.1
wear 98.1
one 98.1
print 96.5
facial expression 95.9
retro 95.7
leader 94.5
paper 94.5
illustration 94.3
two 92.7
vintage 91
furniture 89.3
administration 89
group 88
antique 87.7

Imagga
created on 2019-06-05

man 39
portrait 33.7
ruler 32.9
male 31.9
senior 30.9
old 25.1
adult 23.5
person 23.1
elderly 23
people 22.9
face 20.6
bow tie 19.7
mature 19.5
business 19.4
businessman 19.4
executive 18.4
money 17.9
glasses 17.6
expression 17.1
happy 16.9
necktie 15.5
retired 15.5
currency 15.3
looking 15.2
handsome 15.2
gray 14.4
retirement 14.4
close 14.3
suit 13.6
grandfather 13.1
office 12.9
aged 12.7
older 12.6
tie 12.3
couple 12.2
dollar 12.1
human 12
cash 11.9
hair 11.9
mug shot 11.6
smile 11.4
one 11.2
eyes 11.2
baron 11
head 10.9
grandma 10.8
men 10.3
manager 10.2
alone 10
elder 9.9
look 9.6
black 9.6
aging 9.6
bill 9.5
garment 9.3
groom 9.2
hand 9.1
photograph 9
bank 9
grandmother 8.8
clothing 8.8
smiling 8.7
sad 8.7
lifestyle 8.7
work 8.6
age 8.6
culture 8.6
professional 8.4
banking 8.3
guy 8.1
lady 8.1
success 8
financial 8
love 7.9
gray hair 7.9
maturity 7.9
happiness 7.8
60s 7.8
wisdom 7.8
sitting 7.7
casual 7.6
sculpture 7.6
vintage 7.4
pensioner 7.2
representation 7.2

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

human face 98.7
wall 96.8
old 95.1
clothing 92.7
text 91.4
man 91.1
person 90.1
posing 77.7
suit 74.2
portrait 71.2
photograph 60
vintage 33.8
picture frame 13.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 68.8%
Sad 15.9%
Confused 4.3%
Surprised 6.1%
Happy 1.1%
Angry 8.9%
Disgusted 2.1%
Calm 61.6%

AWS Rekognition

Age 14-23
Gender Male, 93%
Calm 37.8%
Surprised 6.3%
Happy 3.3%
Disgusted 2.5%
Angry 10.5%
Sad 28.3%
Confused 11.3%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a vintage photo of a person in a suit and tie 97.4%
a vintage photo of a person in a suit posing for a picture 96.8%
a vintage photo of a person in a suit posing for the camera 96.2%