Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.: Summer Playroom. Provided by the Episcopal City Mission.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3066.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.: Summer Playroom. Provided by the Episcopal City Mission.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3066.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.6
Human 99.6
Person 95.4
Person 95.1
Person 93.8
Leisure Activities 92.2
Art 92.2
Painting 92.2
Person 90.8
Person 87.9
Piano 87.8
Musical Instrument 87.8
Person 87.1
Person 83.5
Person 76.3
Person 75.1
Room 72.1
Indoors 72.1
Person 66.8
People 65.5
Person 65.2
Person 62.6
Person 61.8
Performer 60.8
Pianist 60.8
Musician 60.8
Grand Piano 58
Poster 57.1
Advertisement 57.1
Living Room 55.4

Clarifai
created on 2019-06-06

people 99.9
adult 98.5
group 98.4
room 97.5
many 97.2
furniture 96.8
man 96.6
chair 96.3
group together 95.4
woman 92.5
leader 92
indoors 90
seat 89.7
administration 89.6
home 89.2
one 85.8
print 81.7
education 78.7
art 78
child 77.7

Imagga
created on 2019-06-06

room 65.9
interior 49.5
furniture 44.6
house 37.7
home 37.6
architecture 35.9
table 31.8
luxury 30
wall 29.8
modern 28.7
lamp 28.6
window 26.9
living 26.5
decor 25.6
design 25.4
bedroom 24.7
sofa 24.2
floor 24.2
chair 23.5
wood 22.5
style 21.5
decoration 20.8
light 19.4
apartment 19.2
residential 18.2
comfortable 18.1
building 16.5
elegant 16.3
old 16
inside 15.6
couch 15.5
estate 15.2
chandelier 15.1
antique 15
fireplace 14.5
space 14
seat 13.4
hotel 13.4
bed 13.3
indoors 13.2
frame 12.8
pillow 12.6
structure 12.6
classic 12.1
residence 12
stucco 11.9
brown 11.8
domestic 11.8
elegance 11.8
carpet 11.7
3d 11.6
panel 11.6
vintage 11.6
real 11.4
relax 10.9
night 10.7
lighting 10.6
glass 10.5
leather 10.4
classroom 10.2
hall 10.1
clean 10
decorative 10
rug 10
travel 9.9
retro 9.8
marble 9.7
expensive 9.6
decorate 9.5
art 9.5
contemporary 9.4
relaxation 9.2
armchair 9.1
indoor 9.1
vase 8.8
lifestyle 8.7
empty 8.6
stylish 8.1
shop 8.1
furnishings 7.9
door 7.9
chairs 7.8
color 7.8
nobody 7.8
stone 7.7
comfort 7.7
rendering 7.6
lifestyles 7.6
rest 7.4
sconce 7.4
anteroom 7.2
black 7.2

Google
created on 2019-06-06

Photograph 96.6
Snapshot 87
Room 80.8
Vintage clothing 70.3
Adaptation 67
Stock photography 65.4
Art 58.1
Family 50.2

Microsoft
created on 2019-06-06

wall 97.1
indoor 96.4
person 89.5
clothing 81
table 75.7
woman 58.1
chair 54.9
furniture 17.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Disgusted 45.3%
Happy 45.1%
Angry 45.8%
Surprised 45.2%
Sad 49.1%
Confused 45.2%
Calm 49.3%

AWS Rekognition

Age 35-52
Gender Female, 54.6%
Sad 54.2%
Confused 45.1%
Calm 45.1%
Disgusted 45.1%
Angry 45.3%
Surprised 45.1%
Happy 45.2%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Sad 50.4%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Angry 49.5%
Surprised 49.5%
Sad 50.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 60-90
Gender Female, 50%
Confused 49.5%
Sad 49.8%
Disgusted 49.5%
Angry 49.7%
Happy 49.6%
Calm 49.8%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Surprised 45.2%
Angry 45.1%
Sad 45.1%
Happy 45.4%
Disgusted 53.6%
Calm 45.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Surprised 49.6%
Happy 49.6%
Sad 49.8%
Angry 49.6%
Disgusted 49.6%
Confused 49.6%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 50.2%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.7%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Angry 49.6%
Disgusted 49.5%
Calm 50%
Happy 49.6%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 9-14
Gender Female, 50.3%
Happy 49.6%
Sad 49.8%
Confused 49.5%
Calm 49.6%
Angry 49.6%
Disgusted 49.8%
Surprised 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Disgusted 49.5%
Confused 49.6%
Happy 49.7%
Sad 49.9%
Surprised 49.6%
Calm 49.6%
Angry 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.5%
Happy 49.7%
Sad 49.5%
Disgusted 49.5%
Calm 50.2%
Surprised 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 35-53
Gender Male, 50.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.9%
Calm 49.8%
Confused 49.5%
Angry 49.6%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.8%
Angry 49.6%
Calm 49.6%
Confused 49.6%
Happy 49.7%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.8%
Angry 49.6%
Confused 49.6%
Happy 49.6%
Disgusted 49.6%
Surprised 49.6%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Confused 49.5%
Happy 49.5%
Sad 50.2%
Disgusted 49.6%
Angry 49.6%
Calm 49.6%
Surprised 49.5%

AWS Rekognition

Age 27-44
Gender Female, 50%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.1%
Happy 49.5%
Disgusted 49.7%

AWS Rekognition

Age 14-23
Gender Male, 50.4%
Surprised 49.6%
Calm 49.5%
Happy 49.5%
Angry 49.6%
Sad 49.7%
Disgusted 50.1%
Confused 49.6%

AWS Rekognition

Age 57-77
Gender Male, 50.4%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.6%
Sad 50.4%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.8%
Calm 47.7%
Sad 46%
Angry 45.9%
Surprised 46.2%
Disgusted 45.5%
Confused 45.3%
Happy 48.4%

AWS Rekognition

Age 35-52
Gender Female, 52.5%
Angry 45.9%
Surprised 45.3%
Disgusted 45.3%
Calm 45.4%
Sad 51.6%
Happy 46.2%
Confused 45.4%

Feature analysis

Amazon

Person 99.6%
Painting 92.2%
Poster 57.1%

Captions

Microsoft
created on 2019-06-06

an old photo of a living room 49.7%
old photo of a living room 44.4%
a clock in the middle of a room 27.3%

Text analysis

Amazon

Mission
Provided
Summer
by
Summer Playroom
Provided by th nal Grty Mission
Grty
th
Playroom
nal

Google

Ploy Summer room Provided by the Epis copol City Mission.
Ploy
Summer
room
Provided
by
the
Epis
copol
City
Mission.