Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.: Caddies. Employed through the summer at the Mt. Washington Hotel and the Mt. Pleasant Hotel, Breton Woods.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3064.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.: Caddies. Employed through the summer at the Mt. Washington Hotel and the Mt. Pleasant Hotel, Breton Woods.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3064.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Classroom 99.8
School 99.8
Room 99.8
Indoors 99.8
Human 99.5
Person 99.5
Person 98.6
Person 97.7
Person 97.5
Person 97.5
Person 96.4
Person 94.9
Person 94.7
Person 93.5
Person 93
Person 88.3
Person 79.9
Person 77.8
Person 60.9
Kindergarten 57.6
Person 47.9

Clarifai
created on 2019-06-06

people 100
many 99.8
group 99.5
adult 98.5
group together 97.6
child 96.2
military 96
uniform 95.5
man 94.6
administration 94.1
crowd 92.8
war 92.3
leader 91.9
soldier 90
boy 88.1
education 87.2
school 86.7
chair 84.9
woman 84.5
outfit 84.4

Imagga
created on 2019-06-06

graffito 50.6
decoration 34
vehicle 29.9
old 20.9
military vehicle 15.4
half track 14.9
grunge 14.5
tracked vehicle 14.4
wheeled vehicle 13.9
military 13.5
transportation 13.4
travel 12
army 11.7
history 11.6
war 11.5
business 10.9
tank 10.8
vintage 10.7
outdoor 10.7
track 10.6
conveyance 10.5
wheel 10.4
ancient 10.4
power 10.1
aged 9.9
machine 9.7
people 9.5
industry 9.4
architecture 9.4
street 9.2
transport 9.1
building 9.1
industrial 9.1
car 9.1
retro 9
antique 8.9
iron lung 8.9
man 8.7
stone 8.7
gun 8.6
day 8.6
sport 8.4
city 8.3
weapon 8.3
sand 8.1
holiday 7.9
soldier 7.8
train 7.7
money 7.6
outdoors 7.5
landscape 7.4
tourism 7.4
symbol 7.4
art 7.3
work 7.3
paint 7.2
respirator 7.1
male 7.1
to 7.1
steel 7.1
sky 7

Google
created on 2019-06-06

Social group 94.5
Team 89.3
State school 86.9
Class 83.8
History 62.6
School 59.6
Child 52

Microsoft
created on 2019-06-06

building 99.2
person 96.3
old 91.6
text 90.9
group 86.7
clothing 84.8
school 79.2
posing 66.4
child 64.8
people 55.9
vintage 30.8
clothes 22.3
several 10.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Male, 51.1%
Calm 45.9%
Disgusted 45.2%
Surprised 45.1%
Confused 45.1%
Angry 48.9%
Sad 49.8%
Happy 45.1%

AWS Rekognition

Age 17-27
Gender Male, 50.7%
Sad 49.5%
Surprised 45.4%
Confused 45.5%
Angry 46.1%
Happy 45.3%
Calm 47.3%
Disgusted 45.8%

AWS Rekognition

Age 35-52
Gender Male, 50.9%
Disgusted 46.1%
Confused 45.4%
Happy 45.2%
Sad 46.7%
Surprised 45.4%
Calm 50.4%
Angry 45.7%

AWS Rekognition

Age 23-38
Gender Male, 53.4%
Angry 45.5%
Calm 46%
Surprised 45.1%
Sad 49%
Disgusted 45.4%
Happy 48.7%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Happy 45.7%
Disgusted 46.7%
Angry 49.4%
Confused 45.3%
Calm 45.1%
Surprised 45.4%
Sad 47.4%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Sad 49.5%
Angry 48.5%
Confused 45.1%
Happy 45.2%
Disgusted 45.1%
Surprised 45.1%
Calm 46.6%

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Surprised 45.3%
Happy 45.3%
Confused 46.4%
Calm 45.6%
Disgusted 46.6%
Sad 50.1%
Angry 45.7%

AWS Rekognition

Age 35-52
Gender Female, 53.4%
Confused 45%
Happy 45.1%
Sad 53.3%
Disgusted 45.1%
Angry 46.6%
Calm 45%
Surprised 45%

AWS Rekognition

Age 19-36
Gender Female, 54.6%
Calm 45%
Angry 53.2%
Happy 45.1%
Sad 46.5%
Surprised 45%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 15-25
Gender Male, 53.8%
Calm 45.4%
Sad 53%
Angry 45.2%
Surprised 45.2%
Disgusted 45.5%
Confused 45.1%
Happy 45.5%

AWS Rekognition

Age 17-27
Gender Male, 53.2%
Calm 45.1%
Confused 45.1%
Happy 45.1%
Surprised 45%
Angry 46.8%
Disgusted 45.1%
Sad 52.8%

AWS Rekognition

Age 27-44
Gender Female, 54.7%
Confused 45.1%
Sad 52.5%
Disgusted 45.3%
Angry 46.1%
Happy 45.4%
Calm 45.4%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 53.4%
Surprised 45.1%
Happy 45.1%
Sad 51.2%
Angry 48.4%
Disgusted 45.1%
Confused 45%
Calm 45.2%

AWS Rekognition

Age 26-43
Gender Male, 51.5%
Angry 48.9%
Happy 45.2%
Confused 45.2%
Surprised 45.2%
Sad 49.6%
Disgusted 45.3%
Calm 45.5%

AWS Rekognition

Age 35-55
Gender Male, 51.4%
Happy 45.2%
Sad 45.4%
Disgusted 47.8%
Calm 49.8%
Surprised 45.2%
Confused 45.2%
Angry 46.4%

AWS Rekognition

Age 26-43
Gender Female, 53.8%
Surprised 45.3%
Disgusted 45.4%
Sad 50.4%
Calm 45.3%
Confused 45.2%
Angry 48.2%
Happy 45.3%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Sad 54.5%
Surprised 45%
Confused 45.1%
Angry 45.2%
Happy 45.1%
Calm 45%
Disgusted 45%

AWS Rekognition

Age 30-47
Gender Female, 53.4%
Sad 46.2%
Confused 45%
Surprised 45.1%
Happy 45.1%
Angry 53.6%
Disgusted 45.1%
Calm 45%

AWS Rekognition

Age 20-38
Gender Male, 50.8%
Calm 45.4%
Happy 45.1%
Confused 45.2%
Sad 51.5%
Angry 47.6%
Surprised 45.1%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Disgusted 45.3%
Happy 45.3%
Angry 45.8%
Surprised 45.4%
Sad 47.8%
Confused 45.4%
Calm 50.2%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Sad 47.4%
Angry 45.2%
Happy 45.1%
Disgusted 45.1%
Calm 51.8%
Surprised 45%
Confused 45.3%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Angry 45.1%
Disgusted 45.1%
Surprised 45%
Calm 45.1%
Sad 54.6%
Happy 45%
Confused 45%

AWS Rekognition

Age 48-68
Gender Female, 50.1%
Confused 45.4%
Disgusted 45.9%
Sad 49.4%
Angry 46.6%
Surprised 45.4%
Happy 45.4%
Calm 46.8%

AWS Rekognition

Age 35-53
Gender Male, 51.2%
Surprised 45.3%
Happy 45.5%
Confused 45.3%
Calm 45.8%
Disgusted 45.2%
Angry 50.3%
Sad 47.6%

AWS Rekognition

Age 10-15
Gender Female, 51.2%
Angry 48.2%
Disgusted 45.1%
Surprised 45.1%
Calm 45.1%
Sad 51%
Happy 45.4%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Male, 54.4%
Disgusted 45.1%
Surprised 45.1%
Sad 52.5%
Angry 45.7%
Happy 45.1%
Confused 45.3%
Calm 46.3%

AWS Rekognition

Age 26-44
Gender Male, 50.3%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%
Sad 50%
Happy 49.5%
Angry 49.8%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Surprised 45.1%
Angry 48.7%
Sad 50.5%
Happy 45.2%
Disgusted 45.2%
Calm 45.2%
Confused 45.2%

AWS Rekognition

Age 16-27
Gender Female, 54.2%
Confused 45%
Surprised 45.1%
Angry 52.5%
Happy 45.2%
Sad 46.9%
Calm 45.1%
Disgusted 45.1%

AWS Rekognition

Age 15-25
Gender Male, 53.1%
Calm 45.4%
Sad 51%
Confused 45.4%
Angry 48.2%
Disgusted 45%
Surprised 45%
Happy 45%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Surprised 45.2%
Happy 45.1%
Sad 52%
Angry 46.5%
Disgusted 45.2%
Confused 45.3%
Calm 45.6%

AWS Rekognition

Age 20-38
Gender Female, 55%
Surprised 45%
Disgusted 45.1%
Angry 45.2%
Sad 54.4%
Happy 45.1%
Confused 45%
Calm 45.2%

AWS Rekognition

Age 35-52
Gender Female, 53.4%
Confused 45%
Happy 45%
Surprised 45.1%
Calm 45%
Angry 45.7%
Sad 54.1%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Male, 51%
Sad 51%
Angry 45.8%
Confused 45.4%
Happy 46.1%
Disgusted 46.4%
Surprised 45.2%
Calm 45.1%

AWS Rekognition

Age 14-23
Gender Female, 50.1%
Calm 45.2%
Disgusted 45%
Surprised 45%
Angry 47.9%
Sad 51.8%
Confused 45%
Happy 45%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.9%
Calm 49.6%
Surprised 49.5%
Confused 49.6%
Sad 49.9%

AWS Rekognition

Age 35-55
Gender Female, 50.6%
Confused 45.1%
Happy 45.1%
Sad 54.1%
Disgusted 45.2%
Angry 45.4%
Calm 45%
Surprised 45.1%

AWS Rekognition

Age 19-36
Gender Female, 54.3%
Surprised 45.1%
Happy 50.6%
Calm 45.1%
Disgusted 45%
Confused 45%
Sad 49.2%
Angry 45.1%

AWS Rekognition

Age 38-59
Gender Female, 50.1%
Angry 49.6%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.2%

AWS Rekognition

Age 4-9
Gender Male, 52.4%
Angry 45.1%
Surprised 45%
Sad 54.4%
Confused 45%
Calm 45.3%
Disgusted 45.1%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Disgusted 45.8%
Confused 45.1%
Calm 47.3%
Surprised 45.1%
Happy 46.4%
Sad 49%
Angry 46.3%

Feature analysis

Amazon

Person 99.5%

Categories

Imagga

paintings art 94.8%
streetview architecture 2%

Text analysis

Amazon

and
Employed
the
Caddies
summer
Hotel
Breton
Woshington
Hotel,
Pleasant
Woods.
Hotel and the Mt. Pleasant Breton Woods.
Employed througyh the summer af the Mt Woshington
ENNY
ENNY SAVINGS
througyh
SAVINGS
Mt
af
Mt.
naS
nas

Google

ENNY SAVING 1T0 Caddies Employed through the summer of the Mt Washing tom Hotel and the Mt. Pleasant Hotel, Breton Woods.
ENNY
SAVING
1T0
Caddies
Employed
through
the
summer
of
Mt
Washing
tom
Hotel
and
Mt.
Pleasant
Hotel,
Breton
Woods.