Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3064

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3064

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99
Person 98.1
Person 98.1
Person 97
Person 92.7
Person 92.7
Person 91.7
Person 91.6
People 91.5
Crowd 90.4
Person 85.7
Person 85.6
Huddle 85.4
Person 83.1
Person 75.6
Person 74.6
Text 67.2
Person 65.8
Person 65.5
Person 64
Person 63.6
Advertisement 58.8
Poster 58.8
Apparel 58.4
Clothing 58.4
Overcoat 58.4
Coat 58.4
Suit 58.4
Condo 57.4
Housing 57.4
Building 57.4
Military Uniform 55.7
Military 55.7
Person 52.4
Person 44

Clarifai
created on 2019-06-06

illustration 97.7
retro 97
people 97
print 96.7
vintage 96.7
art 96.7
old 96.3
paper 94.2
antique 91.9
adult 91
architecture 90.8
no person 90.5
building 89.7
text 89.6
painting 89.6
man 89.2
group 88.6
ancient 87.9
city 87.1
bill 86.7

Imagga
created on 2019-06-06

sketch 66.1
drawing 56.3
representation 39.4
envelope 31.4
paper 29
vintage 28.1
grunge 28.1
money 28.1
old 26.5
currency 26
retro 25.4
cash 22
graffito 21.9
bank 20.6
container 19.5
finance 19.4
antique 18.2
bill 18.1
business 17.6
note 17.5
ancient 17.3
decoration 17.2
dollar 16.7
texture 16
banking 15.6
aged 15.4
wealth 15.3
financial 14.3
design 14.2
bills 13.6
dollars 13.5
exchange 13.4
stamp 12.8
product 12.6
frame 12.5
blank 12
structure 11.9
dirty 11.8
sign 11.3
savings 11.2
letter 11
banknote 10.7
daily 10.6
us 10.6
wall 10.3
symbol 10.1
art 9.9
billboard 9.8
states 9.7
office 9.6
newspaper 9.6
pattern 9.6
empty 9.4
card 9.4
creation 9.3
wallpaper 9.2
investment 9.2
close 9.1
border 9
brown 8.8
textured 8.8
graphic 8.8
pay 8.6
united 8.6
space 8.5
paint 8.2
history 8.1
market 8
book 7.9
postage 7.9
black 7.8
hundred 7.8
comic book 7.7
notes 7.7
mail 7.7
worn 7.6
damaged 7.6
old fashioned 7.6
silhouette 7.5
rich 7.4
page 7.4
economy 7.4
grain 7.4
message 7.3
global 7.3
detail 7.2
collection 7.2
world 7.2
signboard 7.2
material 7.1

Google
created on 2019-06-06

Text 92.7
Art 74
Collection 71.8
Room 71.4
History 70.9
Font 68.6
Visual arts 62.5
Photography 62.4
Paper product 57.7
Illustration 57.7
Paper 51

Microsoft
created on 2019-06-06

scene 78.4
gallery 77.7
room 71.3
drawing 68.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.7%
Confused 49.5%
Calm 49.9%
Disgusted 49.6%
Angry 49.6%
Surprised 49.5%
Happy 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%
Surprised 49.5%
Happy 49.5%
Sad 50.3%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Angry 49.6%
Surprised 49.5%
Disgusted 49.7%
Sad 49.9%
Happy 49.6%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 45-65
Gender Male, 50.3%
Calm 50.4%
Sad 49.5%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-55
Gender Male, 50.4%
Angry 49.7%
Calm 49.8%
Sad 49.7%
Surprised 49.6%
Disgusted 49.5%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Male, 50.3%
Calm 49.5%
Sad 49.9%
Happy 49.5%
Confused 49.6%
Angry 49.6%
Surprised 49.5%
Disgusted 49.9%

AWS Rekognition

Age 23-38
Gender Male, 50.2%
Angry 49.5%
Calm 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.5%
Happy 50.3%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Calm 50.3%
Sad 49.6%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.6%
Angry 49.9%
Disgusted 49.6%
Surprised 49.5%
Happy 49.6%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Calm 49.8%
Confused 49.6%
Happy 49.7%
Disgusted 49.6%
Angry 49.6%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 17-27
Gender Male, 50.3%
Confused 49.6%
Disgusted 49.5%
Sad 50.2%
Angry 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Surprised 49.5%
Disgusted 49.6%
Sad 49.9%
Calm 49.6%
Confused 49.6%
Angry 49.8%
Happy 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Sad 50.1%
Calm 49.7%
Happy 49.5%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 4-9
Gender Female, 50%
Angry 49.6%
Disgusted 49.6%
Surprised 49.5%
Calm 49.5%
Sad 50.1%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Angry 49.7%
Disgusted 49.6%
Surprised 49.5%
Calm 49.5%
Sad 50%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Confused 49.6%
Disgusted 49.6%
Calm 49.6%
Sad 49.7%
Angry 49.6%
Happy 49.8%
Surprised 49.6%

AWS Rekognition

Age 15-25
Gender Male, 50.2%
Surprised 49.5%
Sad 50%
Disgusted 49.5%
Happy 49.5%
Confused 49.6%
Calm 49.7%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%
Angry 49.5%
Calm 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50.5%
Disgusted 49.6%
Confused 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Angry 50.2%
Sad 49.7%

AWS Rekognition

Age 14-25
Gender Female, 50.3%
Confused 49.6%
Calm 49.5%
Disgusted 49.6%
Sad 49.9%
Happy 49.6%
Angry 49.8%
Surprised 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 49.5%
Disgusted 49.6%
Happy 49.8%
Confused 49.5%
Surprised 49.6%
Sad 49.6%
Angry 50%

AWS Rekognition

Age 15-25
Gender Male, 50%
Calm 49.5%
Disgusted 49.5%
Angry 50.1%
Happy 49.5%
Sad 49.8%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Sad 50.4%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.1%
Calm 49.6%
Surprised 49.6%
Happy 49.6%
Disgusted 49.6%
Angry 49.9%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 4-9
Gender Female, 50.3%
Confused 49.6%
Happy 49.6%
Surprised 49.5%
Calm 49.9%
Angry 49.6%
Sad 49.9%
Disgusted 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50.5%
Angry 49.6%
Sad 50%
Calm 49.6%
Disgusted 49.7%
Happy 49.5%
Surprised 49.5%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50%
Angry 49.6%
Surprised 49.6%
Disgusted 49.6%
Calm 49.7%
Sad 49.7%
Happy 49.7%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Calm 49.8%
Disgusted 49.6%
Surprised 49.5%
Angry 49.8%
Sad 49.7%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Surprised 49.5%
Happy 49.6%
Confused 49.5%
Calm 49.9%
Disgusted 49.8%
Sad 49.6%
Angry 49.6%

AWS Rekognition

Age 19-36
Gender Male, 50.2%
Angry 49.6%
Confused 49.5%
Calm 49.7%
Surprised 49.5%
Sad 50%
Happy 49.6%
Disgusted 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Sad 50.2%
Disgusted 49.5%
Calm 49.7%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Calm 49.5%
Disgusted 49.5%
Angry 49.7%
Happy 50.2%
Sad 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 10-15
Gender Female, 50.4%
Angry 49.5%
Calm 49.6%
Surprised 49.5%
Sad 50.3%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 10-15
Gender Female, 50.1%
Calm 50%
Disgusted 49.5%
Surprised 49.5%
Angry 49.6%
Sad 49.8%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.7%
Sad 50.2%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50%
Calm 49.6%
Angry 49.7%
Happy 49.5%
Sad 50.1%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Calm 49.5%
Sad 50.1%
Angry 49.8%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 16-27
Gender Male, 50.1%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.4%
Disgusted 49.5%

AWS Rekognition

Age 35-53
Gender Female, 50.2%
Calm 49.7%
Confused 49.5%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.5%
Sad 50%

AWS Rekognition

Age 15-25
Gender Female, 50%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 45-63
Gender Female, 50.5%
Angry 49.7%
Calm 49.5%
Surprised 49.5%
Sad 50.2%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.5%
Sad 49.9%
Disgusted 49.5%
Calm 49.9%
Surprised 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.4%
Calm 49.6%
Sad 50.2%
Happy 49.5%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Person 98.1%
Poster 58.8%

Categories

Imagga

text visuals 54.2%
paintings art 45%

Captions

Microsoft
created on 2019-06-06

a group of people posing for a photo 26.8%
a display in a room 26.7%
a person posing for the camera 26.6%

Text analysis

Amazon

End
House,
South End House, Boston, Mass.
Mass.
Boston,
South
Boll
Nine
the
Sase Boll Nine
Hotel the Plcoant Hotel,
Plcoant
Hotel
Emplayand
MM
Thrsh
Hotel,
Coddias
Sase
Emplayand Thrsh thn MM lor
lor
G $C17..3-
thn

Google

Se
314
South
House,
Mass.
s8,
Base
Boll
Employed
through
Mi
fom
Hotel
and
he
Mt
Pleaant
Hotel,
Breton
Woods
G Se 314 South End House, Boston, Mass. s8, Base Boll Nine Employed through the summer of the Mi Wouhing fom Hotel and he Mt Pleaant Hotel, Breton Woods
G
End
Boston,
Nine
the
summer
of
Wouhing