Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Henry Booth House": Henry Booth House, Chicago, Ill.: Where the settlement began.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2827.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Henry Booth House": Henry Booth House, Chicago, Ill.: Where the settlement began.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 96.3
Human 96.3
Building 94.5
Housing 94.5
Person 92.4
Person 87.7
House 79.1
Urban 78.8
Person 73.5
Person 71.4
Outdoors 70.1
Drawing 69.5
Art 69.5
Neighborhood 68
Nature 65
Transportation 63.2
Person 61.7
Vehicle 61.1
Brick 60.7
Mansion 59.8
People 59.8
Rural 59.5
Shelter 59.5
Countryside 59.5
Cottage 59
Sketch 58.5
Steeple 56.9
Architecture 56.9
Spire 56.9
Tower 56.9
Postal Office 55.9
Porch 55.8

Clarifai
created on 2019-06-05

home 99.8
people 99.2
no person 99
house 97.9
building 95
group 93.9
family 93.9
architecture 92.2
old 89.5
street 89.2
vintage 89
calamity 87.8
group together 85.6
farmhouse 85.5
man 84.6
town 84.5
print 84.1
war 82
adult 81.5
many 80.8

Imagga
created on 2019-06-05

building 67.4
house 61.8
architecture 50
structure 48
home 45.6
school 41.3
picket fence 39.6
fence 34.9
residence 33.9
estate 27.6
palace 26.8
dwelling 26.3
brick 24.8
old 24.4
barrier 23.6
residential 23
real 22.8
bungalow 22.3
property 22.3
history 20.6
construction 19.7
window 16.8
roof 16.4
windows 16.4
travel 16.2
obstruction 15.8
landscaping 15.8
city 15
historic 14.7
sky 14.7
lawn 14.2
ancient 13.9
street 13.8
facade 13.7
stone 13.6
garage 13.4
modern 13.4
town 13
new 13
suburban 12.8
grass 12.7
housing 12.5
door 12.4
exterior 12
landscape 11.9
neighborhood 11.8
yard 11.7
wall 11.6
expensive 11.5
center 11.3
famous 11.2
luxury 11.2
investment 11
village 11
wood 10.9
tourism 10.7
houses 10.7
suburbs 9.9
upscale 9.9
driveway 9.9
wooden 9.7
country 9.7
buildings 9.5
historical 9.4
culture 9.4
university 9.3
tree 9.3
tile 9.2
family 8.9
mortgage 8.8
medieval 8.7
contemporary 8.5
summer 8.4
church 8.3
castle 8
homestead 7.9
realty 7.9
landscaped 7.9
temple 7.8
grand 7.8
museum 7.8
garden 7.8
entrance 7.7
architectural 7.7
living 7.6
single 7.4
religion 7.2
tower 7.2
urban 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

building 99.9
outdoor 99.5
house 94.8
old 91.3
white 60.6

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 50.2%
Calm 49.5%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Disgusted 50.3%
Sad 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.6%
Confused 49.5%
Calm 49.6%
Disgusted 49.7%
Happy 50%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Male, 50.3%
Surprised 49.5%
Confused 49.5%
Sad 49.7%
Disgusted 49.5%
Calm 49.7%
Angry 49.6%
Happy 49.8%

Feature analysis

Amazon

Person 96.3%

Captions

Microsoft

a vintage photo of an old building 94.2%
a vintage photo of a house 94.1%
a vintage photo of an old house 94%

Text analysis

Amazon

SEI