Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City
Date

c. 1903
People

Artist: J. H. Adams, American active 1900s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2392

Human Generated Data

Title

Races, Immigration: United States. New York. New York City. Immigrant Station: Regulation of Immigration at the Port of Entry. United States Immigrant Station, New York City

People

Artist: J. H. Adams, American active 1900s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2392

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Person 98.1
Human 98.1
Person 98.1
Person 93.4
Person 91.8
Person 88.9
Person 87.1
Text 87.1
Person 86.9
Person 83.4
Advertisement 82.3
Poster 81.2
Person 80.9
Person 79.4
Person 78.5
Art 76.2
Person 73.8
Collage 57.6
Musical Instrument 55.9
Musician 55.9
Person 44.4

Clarifai
created on 2018-04-18

people 98.3
no person 95.5
painting 95
adult 93.6
art 93.1
group 92.6
illustration 91.9
exhibition 91.5
woman 91.4
man 90.8
indoors 87.3
many 86.9
print 86.6
picture frame 85.8
wear 83.5
museum 83
portrait 82.9
travel 81.2
one 80.1
retro 80

Imagga
created on 2018-04-18

blackboard 71.7
grunge 27.2
frame 20.8
old 19.5
menorah 18.4
design 18
art 16.4
pattern 16.4
retro 16.4
paper 15.7
texture 15.3
candelabrum 14.8
graphic 14.6
border 13.6
vintage 13.3
aged 12.7
dirty 12.6
antique 12.2
candlestick 11.1
web site 10.8
black 10.8
film 10.8
water 10.7
paint 9.9
stain 9.6
ancient 9.5
blank 9.4
decoration 9.2
wallpaper 9.2
messy 8.7
structure 8.6
space 8.5
floral 8.5
card 8.5
holder 8.4
decorative 8.3
backgrounds 8.1
window 7.9
screen 7.7
glass 7.7
dirt 7.6
house 7.5
silhouette 7.4
element 7.4
page 7.4
book jacket 7.3
color 7.2
architecture 7

Google
created on 2018-04-18

collection 76.9
product design 59.9
font 52.5
brand 52.3

Microsoft
created on 2018-04-18

gallery 79.2
room 63.4
old 47.7
different 34.3
picture frame 8.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Confused 45.3%
Happy 45.1%
Calm 54.1%
Sad 45.1%
Angry 45.1%
Disgusted 45%
Surprised 45.2%

AWS Rekognition

Age 35-55
Gender Male, 51.2%
Angry 45.1%
Disgusted 53.7%
Happy 45.1%
Sad 45%
Surprised 45.1%
Confused 45.1%
Calm 45.8%

AWS Rekognition

Age 26-43
Gender Male, 51.6%
Confused 45.9%
Sad 48.6%
Surprised 45.3%
Disgusted 45.2%
Happy 46.7%
Calm 47.8%
Angry 45.5%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Sad 48.7%
Surprised 45.3%
Angry 45.7%
Calm 49.1%
Happy 45%
Disgusted 45.1%
Confused 46%

AWS Rekognition

Age 26-43
Gender Male, 53.2%
Happy 45.1%
Disgusted 45.3%
Sad 46.5%
Angry 45.7%
Surprised 47.5%
Calm 49%
Confused 45.9%

AWS Rekognition

Age 35-52
Gender Male, 52%
Disgusted 45.6%
Happy 45.4%
Sad 45.3%
Calm 51%
Angry 45.8%
Confused 46.2%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 50.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Confused 45.6%
Sad 51.7%
Surprised 45.1%
Happy 45%
Disgusted 45.4%
Calm 45.8%
Angry 46.4%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.6%
Happy 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.5%
Confused 49.5%
Sad 50.3%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.7%
Calm 49.5%
Sad 50.1%
Happy 49.5%
Angry 49.6%

AWS Rekognition

Age 15-25
Gender Male, 50.1%
Sad 49.8%
Confused 49.5%
Happy 49.5%
Angry 49.8%
Calm 49.6%
Disgusted 49.7%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Happy 46.8%
Confused 47%
Sad 45.5%
Surprised 45.2%
Calm 49.6%
Disgusted 45.3%
Angry 45.7%

AWS Rekognition

Age 6-13
Gender Female, 54.8%
Happy 45.1%
Angry 45.7%
Disgusted 45.2%
Calm 46%
Confused 45.3%
Surprised 45.1%
Sad 52.6%

AWS Rekognition

Age 45-65
Gender Male, 54.6%
Angry 45.5%
Disgusted 45.2%
Sad 45.5%
Calm 52.6%
Happy 45.1%
Confused 45.7%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.1%
Angry 49.8%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-44
Gender Male, 52.3%
Happy 45.1%
Confused 45.4%
Sad 48%
Surprised 45.1%
Calm 50.8%
Disgusted 45.2%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Confused 49.5%
Angry 49.6%
Sad 50.1%
Calm 49.6%
Happy 49.6%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Calm 49.6%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Sad 50.4%
Happy 49.5%

AWS Rekognition

Age 6-13
Gender Male, 52.9%
Disgusted 45%
Angry 54.1%
Sad 45.8%
Calm 45%
Happy 45.1%
Surprised 45%
Confused 45%

AWS Rekognition

Age 20-38
Gender Female, 54%
Surprised 45.1%
Disgusted 45.1%
Angry 45.3%
Happy 45.1%
Sad 53.9%
Calm 45.2%
Confused 45.4%

AWS Rekognition

Age 6-13
Gender Female, 54.7%
Happy 45%
Confused 45.1%
Surprised 45.1%
Calm 48%
Disgusted 45.1%
Angry 45.2%
Sad 51.5%

AWS Rekognition

Age 26-44
Gender Female, 50.3%
Calm 49.5%
Angry 49.7%
Disgusted 49.7%
Sad 50%
Confused 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 45-66
Gender Male, 50.4%
Happy 49.8%
Sad 49.6%
Surprised 49.5%
Calm 49.9%
Disgusted 49.6%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.5%
Sad 50.3%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 49.6%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Male, 53.9%
Surprised 45.2%
Happy 45.3%
Calm 45.7%
Angry 46.5%
Confused 45.3%
Sad 46.9%
Disgusted 50%

AWS Rekognition

Age 14-25
Gender Female, 50.3%
Sad 49.7%
Confused 49.5%
Calm 49.7%
Disgusted 49.7%
Angry 49.7%
Happy 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Male, 53.3%
Confused 46.1%
Surprised 45.9%
Disgusted 45%
Angry 45.3%
Calm 52.2%
Sad 45.4%
Happy 45.1%

AWS Rekognition

Age 26-44
Gender Female, 50%
Calm 49.9%
Angry 49.7%
Disgusted 49.7%
Surprised 49.5%
Confused 49.5%
Sad 49.7%
Happy 49.5%

AWS Rekognition

Age 17-27
Gender Male, 50%
Sad 49.6%
Happy 49.6%
Disgusted 50%
Confused 49.5%
Calm 49.7%
Surprised 49.6%
Angry 49.6%

AWS Rekognition

Age 16-27
Gender Male, 50.2%
Calm 49.7%
Surprised 49.6%
Confused 49.6%
Angry 49.6%
Happy 49.9%
Sad 49.6%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Male, 52.3%
Angry 45.8%
Disgusted 46.7%
Happy 45.1%
Sad 45.3%
Surprised 45.3%
Calm 51.5%
Confused 45.4%

AWS Rekognition

Age 35-53
Gender Male, 54.6%
Sad 47.7%
Surprised 45.1%
Angry 45.7%
Calm 45.7%
Happy 45.4%
Disgusted 50%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Female, 53.3%
Surprised 45%
Calm 45.1%
Disgusted 45%
Confused 45%
Sad 54.6%
Angry 45.2%
Happy 45%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Sad 50.4%
Angry 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Happy 49.6%
Sad 49.5%
Surprised 49.5%
Calm 49.7%
Disgusted 49.6%
Confused 49.6%
Angry 50%

AWS Rekognition

Age 23-38
Gender Male, 50.3%
Happy 49.5%
Angry 49.5%
Disgusted 49.6%
Calm 50.2%
Confused 49.5%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Surprised 49.5%
Disgusted 50%
Confused 49.5%
Calm 49.6%
Happy 49.5%
Angry 49.6%
Sad 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Confused 49.6%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 50.2%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Calm 49.6%
Happy 49.5%
Sad 50.3%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.5%
Confused 49.5%
Sad 50.4%
Surprised 49.5%
Calm 49.5%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Male, 52.7%
Happy 47.6%
Disgusted 46.2%
Confused 45.9%
Sad 45.5%
Surprised 46.2%
Angry 45.6%
Calm 48.1%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 49.9%
Angry 49.6%
Disgusted 49.6%
Sad 49.9%
Confused 49.6%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.9%
Happy 45.1%
Disgusted 45.2%
Confused 45.4%
Angry 50.9%
Calm 46.1%
Sad 47.2%
Surprised 45.2%

AWS Rekognition

Age 26-44
Gender Male, 50.2%
Disgusted 50.2%
Happy 49.5%
Sad 49.5%
Calm 49.5%
Angry 49.6%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-23
Gender Female, 50.3%
Confused 49.6%
Angry 49.6%
Calm 49.7%
Sad 49.8%
Disgusted 49.6%
Happy 49.7%
Surprised 49.6%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Poster 81.2%

Captions

Microsoft
created on 2018-04-18

a vintage photo of a box 45.7%
a vintage photo of a sign 45.6%
a vintage photo of a person 40.8%

Text analysis

Amazon

Regulation
United
City
York
Entry
Immigrant
Immigration
States
Port
New
of
Regulation of Immigration at the Port of Entry
the
United States Immigrant Statio' n. New York City
Statio'
WAITING
at
THE
AGROUP
n.
AND WAMEY
AGROUP THE MEN'S DLTAINED.
MEN'S
GRaes:7316
AND WAMEY WAITING FoR PeNDS
DLTAINED.
FoR
PeNDS

Google

Regulation of Immigration a the Port of Entry United States Immigrant Statio n, New York City ArW YORK DETAINED, MEN AND WOMEN WAITING FOR FRIEND与 A GROUP JN THE MENS DETAINED
Regulation
of
Immigration
a
the
Port
Entry
United
States
Immigrant
Statio
n,
New
York
City
ArW
YORK
DETAINED
,
MEN
AND
WOMEN
WAITING
FOR
FRIEND
与
A
GROUP
JN
THE
MENS