Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the "Treatment" at Camp
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2770.3

Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the "Treatment" at Camp

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2770.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Nature 100
Blizzard 100
Outdoors 100
Storm 100
Winter 100
Snow 100
Person 90.8
Human 90.8
Weather 85.8
Countryside 85.5
Building 82.8
Shelter 80.7
Rural 80.7
Hut 66.4
Housing 62.2
Shack 55.9

Clarifai
created on 2019-06-05

winter 98.8
snow 96.7
no person 96.5
wood 96.5
people 96
home 94.2
building 92.8
vehicle 92.7
storm 91.9
weather 91.4
cold 91.1
transportation system 87.5
war 86.5
fence 83.9
house 82.2
calamity 81.3
frozen 79.1
group 79
military 77.9
adult 76.9

Imagga
created on 2019-06-05

shopping cart 75
handcart 60.7
wheeled vehicle 47.6
snow 45.8
winter 37.5
barn 34.6
structure 34.3
building 33.5
cold 31
container 28.5
landscape 26.8
forest 25.3
farm building 23.1
season 22.6
trees 22.3
hut 22
old 21.6
sky 21.1
wood 20
snowy 19.5
tree 19.2
house 19.2
outdoor 19.1
ice 18.5
weather 18.2
rural 17.6
conveyance 16.8
fence 16.7
frozen 16.2
shelter 15.8
architecture 15.7
frost 15.4
park 14.1
travel 13.4
country 13.2
woods 12.4
scenic 12.3
scene 12.1
scenery 11.7
wooden 11.4
seasonal 11.4
road 10.8
river 10.7
fog 10.6
home 10.4
light 10
freeze 9.7
outdoors 9.7
water 9.3
holiday 9.3
mountains 9.3
history 8.9
mist 8.7
construction 8.6
city 8.3
vintage 8.3
mountain 8
ski 7.8
frosty 7.8
covered 7.8
quiet 7.7
north 7.7
vacation 7.4
peaceful 7.3
new 7.3
cool 7.1
day 7.1

Google
created on 2019-06-05

Winter 87.3
Snow 84.7
Tree 81.4
State park 76.4
House 73.1
Log cabin 68.7
Home 68.2
Architecture 65.5
Sugar house 57.2
Building 57
Black-and-white 56.4
Freezing 55.4

Microsoft
created on 2019-06-05

tree 99.7
snow 99.6
outdoor 99.5
building 89.6
house 87.6
bridge 52.9
wood 38.7
area 34.4
forest 21.6
day 12.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Sad 50.5%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Confused 49.5%
Happy 50.2%
Calm 49.6%
Sad 49.6%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Disgusted 49.6%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Sad 49.6%
Calm 50%
Happy 49.7%

Feature analysis

Amazon

Person 90.8%

Categories

Imagga

streetview architecture 45.4%
nature landscape 43.4%
paintings art 9.2%
beaches seaside 1.2%

Captions

Microsoft
created on 2019-06-05

a pile of snow next to a fence 81.1%
a pile of snow next to a wooden fence 74.9%
a pile of snow 74.8%

Text analysis

Amazon

HILL SIDE.

Google

HILL SIDE
HILL
SIDE