Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Seamens Church Institute": "Seamens Church Institute of New York", New York City. Formerly the Protestant Episcopal Church Missionary Society for Seamen in the City and Port of New York
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3138.1

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Seamens Church Institute": "Seamens Church Institute of New York", New York City. Formerly the Protestant Episcopal Church Missionary Society for Seamen in the City and Port of New York

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3138.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.5
Human 99.5
Person 98.8
Person 97.7
Person 97.6
Person 97.6
Person 97.6
Person 97.4
Person 94.9
Indoors 89.7
Interior Design 89.7
Person 82.5
Room 78.6
Advertisement 78.5
Poster 78.5
Person 76.5
Person 75.5
Clinic 67.1
Painting 64.8
Art 64.8
Crowd 64.1
Person 50.9

Clarifai
created on 2019-06-06

people 99.9
group 99.6
many 99.1
adult 97.5
print 96
man 95.8
administration 95.7
war 94
woman 93.4
lithograph 92.9
room 91.8
child 91.7
leader 91.6
music 90.6
group together 90.2
musician 89.8
military 87
furniture 85.9
crowd 85.5
wear 85.3

Imagga
created on 2019-06-06

room 26
classroom 25.7
people 21.2
old 20.2
man 20.1
business 18.2
person 17.8
male 16.3
vintage 13.2
building 12.8
money 12.7
adult 12.1
office 12
life 11.7
art 11
finance 11
architecture 10.9
monument 10.3
dollar 10.2
cash 10.1
city 10
aged 9.9
bank 9.8
history 9.8
portrait 9.7
ancient 9.5
bill 9.5
banking 9.2
indoor 9.1
retro 9
uniform 9
currency 9
group 8.9
home 8.8
clothing 8.7
rifle 8.7
antique 8.6
paper 8.6
sculpture 8.6
men 8.6
senior 8.4
teacher 8.4
photographer 8.3
musical instrument 8.1
gun 8
family 8
professional 7.8
work 7.8
soldier 7.8
black 7.8
brass 7.8
military 7.7
us 7.7
exchange 7.6
one 7.5
close 7.4
symbol 7.4
historic 7.3
success 7.2
wind instrument 7.2
interior 7.1
working 7.1

Google
created on 2019-06-06

Photograph 95.9
Snapshot 87
Room 65.7
History 64.5
Family 57.7

Microsoft
created on 2019-06-06

clothing 97.9
person 97.9
old 92.2
woman 83.4
man 81.4
group 80.4
newspaper 67.9
people 59.9
posing 52.5
clothes 34.9
line 20.2
several 10.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Confused 45.3%
Angry 47.1%
Disgusted 45.2%
Calm 51.6%
Happy 45.2%
Surprised 45.2%
Sad 45.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Confused 45.1%
Sad 45.1%
Disgusted 45.1%
Angry 45.1%
Happy 45.2%
Calm 54.2%
Surprised 45.2%

AWS Rekognition

Age 23-38
Gender Male, 54.5%
Sad 45.1%
Angry 45.1%
Calm 54.7%
Confused 45.1%
Happy 45%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Surprised 45.9%
Happy 45.3%
Sad 45.5%
Angry 45.8%
Disgusted 45.6%
Confused 45.8%
Calm 51.1%

AWS Rekognition

Age 26-43
Gender Male, 51.8%
Disgusted 45.1%
Confused 45.1%
Happy 45.7%
Sad 45.3%
Surprised 45.3%
Calm 53.5%
Angry 45.1%

AWS Rekognition

Age 48-68
Gender Male, 54.7%
Sad 46.4%
Angry 45.5%
Confused 45.5%
Happy 49.5%
Disgusted 45.3%
Surprised 46.6%
Calm 46.2%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Happy 45.2%
Sad 45.4%
Confused 45.1%
Calm 53.5%
Angry 45.2%
Disgusted 45.3%
Surprised 45.4%

AWS Rekognition

Age 45-66
Gender Male, 54.8%
Surprised 45.6%
Disgusted 45.2%
Angry 45.5%
Sad 46.5%
Happy 45.6%
Confused 45.7%
Calm 50.8%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Calm 54.2%
Disgusted 45%
Angry 45.4%
Happy 45%
Sad 45.2%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Sad 46.2%
Angry 45.5%
Happy 45.6%
Disgusted 45.3%
Calm 51.4%
Surprised 45.8%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Male, 50.8%
Surprised 45.6%
Angry 45.3%
Sad 45.4%
Happy 45.3%
Disgusted 45.5%
Calm 52.7%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Male, 54.5%
Sad 45.9%
Angry 49.9%
Confused 45.4%
Happy 45.1%
Disgusted 45.8%
Surprised 45.3%
Calm 47.6%

AWS Rekognition

Age 45-63
Gender Male, 55%
Surprised 45.3%
Disgusted 45%
Sad 45.4%
Calm 53.5%
Confused 45.3%
Angry 45.5%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Surprised 48.6%
Disgusted 45.3%
Sad 45.5%
Calm 49.8%
Confused 45.3%
Angry 45.3%
Happy 45.2%

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Calm 54.1%
Confused 45.1%
Happy 45.1%
Disgusted 45.1%
Sad 45.3%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 57-77
Gender Female, 51.3%
Sad 49.6%
Calm 47.5%
Happy 45.7%
Surprised 45.6%
Angry 45.9%
Disgusted 45.4%
Confused 45.4%

AWS Rekognition

Age 35-52
Gender Female, 52.2%
Disgusted 45.3%
Confused 45.4%
Calm 47%
Surprised 45.4%
Happy 45.3%
Sad 51.1%
Angry 45.5%

AWS Rekognition

Age 48-68
Gender Female, 50.8%
Angry 45.7%
Confused 45.1%
Calm 45.3%
Surprised 45.2%
Sad 53%
Happy 45.4%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 53.1%
Angry 45.2%
Calm 51.4%
Sad 47.9%
Surprised 45.1%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50.2%
Angry 46.2%
Disgusted 45.5%
Surprised 45.6%
Calm 47.9%
Sad 46.5%
Happy 48.1%
Confused 45.3%

AWS Rekognition

Age 23-38
Gender Male, 52.5%
Angry 45.5%
Surprised 45.3%
Disgusted 47%
Calm 50.6%
Sad 45.8%
Happy 45.6%
Confused 45.3%

AWS Rekognition

Age 45-66
Gender Female, 50.1%
Confused 49.6%
Calm 49.7%
Disgusted 49.5%
Sad 50.2%
Happy 49.5%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 30-47
Gender Male, 51.3%
Happy 46.8%
Sad 47.2%
Disgusted 45.4%
Calm 48.6%
Surprised 45.5%
Confused 45.4%
Angry 45.9%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Calm 47.2%
Angry 47.6%
Happy 45.8%
Sad 46%
Surprised 45.6%
Confused 46.3%
Disgusted 46.5%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 78.5%
Painting 64.8%

Categories

Imagga

paintings art 34.8%
interior objects 29.5%
streetview architecture 24.4%
text visuals 8.4%
food drinks 1.5%

Text analysis

Amazon

ficit
1844:
Sustains
Protestant
ing-roons
the
read-
York
Episcopal
in
"Seamen'
and
fund.
ing-roons and 2
Institute
York"
Formerlv
Formerlv the Protestant Episcopal Church issionarv Society Soci
endowment
met
City.
Chrch
Society
Seamen
Soci
Church
New
endowrient:de-
of
voluntary
2
3
"Seamen' Chrch Institute of New York" Nev York City.
ficit met B1 draft; upon endowment fund. Sustains 3 Free read-
Port
supported
incorporated
For Seamen in the City and Port of New York; incorporated
1844: supported BY voluntary contribution and endowrient:de-
draft;
contribution
issionarv
York;
Free
upon
For
Nev
City
BY
B1
sm

Google

"Seamen's Church Institute of New York", New York City. Formerly the Protestant piscopal Church Missionary Society for Seamen in the City and Port of New York; incorporated 1844; supported by voluntary contribu tions and endownent;de- ficit met by draft upon endowment fund. Sustains 3 free read- ing-roons and 2 churches, each in charge of a chaplain, and the Mission boat "Sentinel",oto visit ships and seamen in the harbor.
"Seamen's
Church
Institute
of
New
York",
York
City.
Formerly
the
Protestant
piscopal
Missionary
Society
for
Seamen
in
City
and
Port
York;
incorporated
1844;
supported
by
voluntary
contribu
tions
endownent;de-
ficit
met
draft
upon
endowment
fund.
Sustains
3
free
read-
ing-roons
2
churches,
each
charge
a
chaplain,
Mission
boat
"Sentinel",oto
visit
ships
seamen
harbor.