Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Seamens Church Institute"
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3138

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Seamens Church Institute"

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.7
Person 99.7
Person 99.4
Person 98.5
Restaurant 95.9
Person 95.1
Chair 94.3
Furniture 94.3
Person 93.7
Person 93.4
Person 93.4
Person 93.2
Cafeteria 88.5
Chair 88.4
Person 86
Person 83.3
Person 82.6
Person 82.2
Person 81.3
Person 79.5
Cafe 75.3
Art 72.7
Crowd 72.3
Person 68.7
Person 63.5
Tabletop 63.4
Meal 61.8
Food 61.8
Person 60.9
Text 60.5
Indoors 58.1
Advertisement 55.1

Clarifai
created on 2019-06-06

people 99.7
group 98.3
adult 98.1
man 96.4
many 93.8
woman 93.1
print 92.4
military 91.8
wear 91.4
war 91.3
group together 90.5
art 89.8
exhibition 89.5
music 88.9
museum 88.8
room 88.5
portrait 87.4
street 86.5
monochrome 86.5
administration 86.2

Imagga
created on 2019-06-06

case 34.1
interior 15.9
architecture 15.6
monitor 15.5
equipment 15.5
house 15
table 14.5
electronic equipment 13.9
design 13.5
old 13.2
window 13.1
light 12
business 11.5
building 11.4
urban 11.4
room 10.8
city 10.8
furniture 10.5
glass 10.4
people 10
art 9.9
home 9.6
3d 9.3
modern 9.1
black 9
technology 8.9
decor 8.8
web site 8.6
vintage 8.4
shop 8.1
symbol 8.1
history 8
kitchen 8
metal 8
office 7.8
travel 7.7
wall 7.7
apartment 7.7
home appliance 7.6
man 7.5
decoration 7.3
indoor 7.3
graphic 7.3
film 7.3
steel 7.1

Google
created on 2019-06-06

Photograph 96.2
Text 89
Snapshot 87.2
Photographic paper 75.1
Photography 67.8
Room 65.7
Picture frame 63.2
Stock photography 59.4
Collection 54
Art 50.2

Microsoft
created on 2019-06-06

person 98.6
clothing 94.3
man 62.1
library 53.9
different 45.9
several 14.1

Face analysis

Amazon

AWS Rekognition

Age 38-57
Gender Male, 50.5%
Angry 49.7%
Surprised 49.5%
Sad 49.6%
Confused 49.5%
Calm 50%
Disgusted 49.5%
Happy 49.7%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.6%
Calm 49.9%
Happy 49.5%
Surprised 49.6%
Sad 49.7%

AWS Rekognition

Age 26-44
Gender Female, 53%
Happy 45.7%
Calm 51.6%
Sad 45.6%
Surprised 45.7%
Angry 45.4%
Confused 45.4%
Disgusted 45.6%

AWS Rekognition

Age 48-68
Gender Male, 50.4%
Calm 49.9%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Sad 50%

AWS Rekognition

Age 26-43
Gender Male, 50%
Angry 49.6%
Calm 49.7%
Surprised 49.5%
Sad 49.8%
Disgusted 49.8%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Disgusted 49.6%
Calm 50%
Confused 49.5%
Happy 49.7%
Surprised 49.6%
Angry 49.6%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Confused 49.5%
Surprised 49.5%
Angry 49.5%
Happy 49.6%
Sad 50.3%
Calm 49.5%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Sad 49.5%
Calm 50.3%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50.1%
Disgusted 49.5%
Confused 49.5%
Happy 50.2%
Sad 49.6%
Surprised 49.6%
Calm 49.5%
Angry 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.1%
Sad 49.6%
Angry 49.7%
Confused 49.6%
Happy 49.8%
Disgusted 49.6%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Calm 49.5%
Confused 49.5%
Happy 50.1%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Sad 49.7%

AWS Rekognition

Age 14-25
Gender Female, 50.2%
Angry 49.5%
Surprised 49.5%
Calm 50.3%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.6%
Surprised 49.6%
Calm 49.6%
Happy 49.8%
Confused 49.6%
Disgusted 49.6%
Sad 49.6%

AWS Rekognition

Age 29-45
Gender Male, 50.3%
Sad 49.7%
Confused 49.5%
Surprised 49.5%
Happy 49.6%
Angry 49.6%
Disgusted 49.6%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Sad 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 50.4%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Confused 49.5%
Disgusted 49.5%
Angry 49.6%
Calm 49.5%
Sad 50.1%
Happy 49.7%
Surprised 49.6%

AWS Rekognition

Age 35-55
Gender Female, 50.3%
Calm 49.8%
Confused 49.5%
Happy 49.6%
Disgusted 49.6%
Sad 49.7%
Angry 49.7%
Surprised 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Sad 49.9%
Confused 49.7%
Calm 49.6%
Disgusted 49.6%
Angry 49.6%
Surprised 49.6%
Happy 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.2%
Confused 49.5%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Calm 49.6%
Sad 49.9%
Confused 49.6%
Angry 49.6%
Disgusted 49.6%
Surprised 49.6%
Happy 49.7%

AWS Rekognition

Age 6-13
Gender Male, 50.4%
Confused 49.7%
Disgusted 49.5%
Angry 49.7%
Calm 49.7%
Sad 49.8%
Happy 49.5%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.6%
Happy 49.5%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 35-52
Gender Female, 50%
Sad 49.8%
Calm 49.8%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.6%
Confused 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.6%
Calm 49.7%
Sad 49.7%
Happy 49.6%
Confused 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Calm 49.6%
Angry 49.5%
Happy 49.5%
Sad 50.3%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.6%
Surprised 49.6%
Happy 49.6%
Disgusted 50.1%
Angry 49.6%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Surprised 49.6%
Sad 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.6%
Calm 49.9%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.6%
Disgusted 49.5%
Calm 49.7%
Confused 49.6%
Happy 49.6%
Surprised 49.6%
Angry 49.8%

AWS Rekognition

Age 35-55
Gender Female, 50.5%
Calm 49.5%
Disgusted 49.6%
Surprised 49.5%
Confused 49.5%
Angry 49.6%
Sad 50.2%
Happy 49.6%

Feature analysis

Amazon

Person 99.7%
Chair 94.3%

Captions

Microsoft

a group of people posing for a photo 41.6%
a group of people posing for the camera 41.5%
a group of people posing for a picture 41.4%

Text analysis

Amazon

Yok
m2
Chn'ch
Saiice
Yoo
recine-rocri.
C$27 73.2

Google

Sea73.2
BUILDING
"Sean's
Sa1lom
St
nd
York
Forserly
ptseopal
spported
voluntary
York,
City.
4
fre
111
Institute
York",
the
Chreh
SEAMEN
lier
n
Protentant
br
eontriitices
Chuarch
and
reading-rocn
Nenr
isstere
1844;
harber
Sea73.2 THE BUILDING SEAMEN "Sean's Chuarch Institute of lier York, Ne York City. Sa1lom and n 4 ont St fre 111 nd reading-rocn Institute of ler York", Nenr York City. Forserly the Protentant ptseopal Chreh isstere Seeiets 1844; spported br voluntary eontriitices and endoment;de ing-roo and e n the harber
THE
of
Ne
ont
ler
Seeiets
endoment;de
ing-roo
e