Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Jacob A. Riis Neighborhood Settlement": The Jacob A. Riis Neighborhood Settlement, New York City.: Roof Garden.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3192.2

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Jacob A. Riis Neighborhood Settlement": The Jacob A. Riis Neighborhood Settlement, New York City.: Roof Garden.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.4
Person 99.4
Person 98.7
Person 98.5
Person 98.5
Person 98.3
Person 96.3
Person 93.6
Person 93.2
Floor 84.4
Art 82.9
Painting 82.9
Person 81.1
Person 74.3
Apparel 72.9
Clothing 72.9
Person 72.1
Flooring 71.7
People 66.1
Person 66.1
Leisure Activities 61.8
Shop 59.7
Building 58.4
Downtown 58.4
City 58.4
Town 58.4
Urban 58.4
Crowd 56.1
Person 46

Clarifai
created on 2019-06-06

people 100
group 99.7
many 99.3
group together 98.5
adult 97.9
print 96
man 94.1
military 93.4
war 93.2
vehicle 91.4
administration 90.4
crowd 90.3
child 90.1
soldier 88
furniture 87.7
home 86.7
room 86.4
street 85.9
several 85.7
transportation system 85.5

Imagga
created on 2019-06-06

sketch 89.1
drawing 66.7
representation 54.1
jigsaw puzzle 42.5
architecture 35.3
puzzle 33.8
city 28.3
sky 25.5
game 24.1
travel 23.9
building 23.2
tourism 19.8
old 19.5
water 18.7
buildings 18
grunge 17.9
landmark 17.2
landscape 17.1
ancient 15.6
tower 15.2
wall 14.9
urban 14.9
structure 14.6
construction 14.5
river 14.3
cityscape 14.2
historic 13.8
sea 13.4
town 13
antique 13
paper 12.5
history 12.5
vintage 12.4
bridge 12.3
ocean 12.3
house 11.9
scenery 11.7
beach 11.7
panorama 11.4
coast 10.8
scenic 10.5
summer 10.3
tree 10
aged 10
silhouette 9.9
retro 9.8
vacation 9.8
texture 9.7
old fashioned 9.5
skyline 9.5
historical 9.4
lake 9.4
snow 9.2
sand 9.2
grain 9.2
business 9.1
black 9
decoration 9
rock 8.7
skyscraper 8.6
culture 8.5
clouds 8.5
exterior 8.3
street 8.3
brown 8.1
trees 8
graffito 7.9
scene 7.8
downtown 7.7
winter 7.7
grungy 7.6
famous 7.4
shore 7.4
design 7.3
horizon 7.2
art 7.2
holiday 7.2
romantic 7.1

Google
created on 2019-06-06

Photograph 96.1
Snapshot 87.2
Room 71.4
Stock photography 69.8
Adaptation 67
Art 65.5
Photographic paper 63.9
Photography 62.4
Paper product 55.7
Illustration 50.4
Collection 50

Microsoft
created on 2019-06-06

building 99.7
old 92.5
person 88.1

Face analysis

Amazon

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Disgusted 49.5%
Happy 49.6%
Angry 49.5%
Surprised 49.5%
Sad 50.1%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Confused 49.5%
Calm 50.1%
Disgusted 49.5%
Sad 49.7%
Happy 49.5%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Calm 49.6%
Happy 49.6%
Sad 49.8%
Angry 49.6%
Confused 49.6%
Disgusted 49.8%
Surprised 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.2%
Calm 49.6%
Happy 49.7%
Sad 50%
Angry 49.6%
Confused 49.5%
Disgusted 49.5%
Surprised 49.6%

Feature analysis

Amazon

Person 99.4%
Painting 82.9%

Captions

Microsoft

a vintage photo of a group of people standing in front of a building 76.7%
a vintage photo of a group of people in front of a building 76.6%
a vintage photo of a group of people standing in front of a store 61.5%

Text analysis

Amazon

Roof
Roof Gorden
Gorden
Su

Google

Gorden
Roof Gorden
Roof