Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Denison House": Denison House, Boston, Mass.: Boys Dramatic Club.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2980

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Denison House": Denison House, Boston, Mass.: Boys Dramatic Club.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 96.8
Person 96.8
Person 93.3
Art 92.8
Person 91.8
Person 91.1
Person 89.8
Person 88.2
Painting 88.2
Person 82.1
Person 81.1
Person 80.9
Person 69.4
Person 63.6
Figurine 63.3
Person 59.9
Person 42.7

Clarifai
created on 2019-06-06

people 98
adult 96.4
art 96.1
museum 96.1
painting 96
exhibition 95.8
picture frame 94.7
wear 94.6
print 94.6
portrait 94
illustration 93.6
group 92.9
blank 90.7
retro 90
furniture 88.9
room 87.4
desktop 87.1
one 86.7
no person 85.8
woman 85.5

Imagga
created on 2019-06-06

envelope 41.1
blackboard 38
vintage 33.1
container 32
old 28.6
chalkboard 28.4
grunge 25.6
board 25.4
finance 22
texture 21.5
retro 21.3
money 21.3
currency 20.6
paper 20.4
frame 20.1
business 20
chalk 19.5
blank 18.9
stamp 18.8
black 18
note 17.5
wall 17.1
cash 16.5
antique 16.4
message 16.4
symbol 16.2
school 16.2
education 15.6
design 15.5
aged 15.4
bill 15.2
letter 14.7
ancient 13.8
brass 13.7
learn 13.2
banking 12.9
structure 12.8
classroom 12.6
bank 12.5
art 12.2
empty 12
global 11.9
communication 11.8
insulating material 11.7
financial 11.6
dollar 11.1
memorial 11.1
dirty 10.8
tray 10.8
postage 10.8
idea 10.7
drawing 10.6
mail 10.5
text 10.5
blade 10.4
icon 10.3
study 10.3
book jacket 10
wood 10
sign 9.8
pattern 9.6
exchange 9.6
rusty 9.5
write 9.4
decoration 9.4
savings 9.3
investment 9.2
border 9
world 9
postmark 8.9
postal 8.8
object 8.8
wooden 8.8
receptacle 8.8
building material 8.8
teach 8.8
hundred 8.7
worn 8.6
post 8.6
grungy 8.5
earth 8.2
cutting implement 7.9
jacket 7.8
reminder 7.8
space 7.8
states 7.7
billboard 7.7
international 7.6
united 7.6
head 7.6
word 7.5
tool 7.5
one 7.5
close 7.4
economy 7.4
detail 7.2
office 7.2
wealth 7.2
market 7.1

Google
created on 2019-06-06

Photograph 96.6
Text 86.9
Snapshot 83.3
Room 74.4
Picture frame 73.1
Photography 62.4
Stock photography 62.1
Art 50.2
Collection 50

Microsoft
created on 2019-06-06

wall 99.1
scene 98.6
indoor 98.5
gallery 98.4
room 95.8
person 90.3
picture frame 82.7
clothing 64
mounted 56.9
painting 51.8
old 40.6
different 33.1
vintage 30.2

Face analysis

Amazon

AWS Rekognition

Age 9-14
Gender Male, 50.2%
Angry 49.6%
Confused 49.6%
Calm 49.7%
Disgusted 49.6%
Happy 49.5%
Surprised 49.5%
Sad 50%

AWS Rekognition

Age 11-18
Gender Male, 50.3%
Calm 49.5%
Confused 49.5%
Happy 49.5%
Disgusted 50.5%
Angry 49.5%
Surprised 49.5%
Sad 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Calm 49.6%
Happy 49.5%
Sad 50.1%
Angry 49.6%
Confused 49.6%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Surprised 49.5%
Sad 49.6%
Disgusted 49.6%
Calm 49.5%
Happy 49.6%
Angry 50.1%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.6%
Disgusted 49.7%
Sad 49.8%
Angry 49.6%
Surprised 49.6%
Happy 49.7%
Calm 49.6%

AWS Rekognition

Age 29-45
Gender Female, 50.4%
Sad 49.7%
Angry 49.6%
Happy 49.6%
Disgusted 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 26-44
Gender Female, 50.3%
Confused 49.5%
Disgusted 49.6%
Angry 49.6%
Calm 49.8%
Sad 49.8%
Happy 49.6%
Surprised 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50.2%
Angry 49.6%
Disgusted 49.6%
Confused 49.5%
Calm 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.2%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Angry 49.6%
Calm 49.6%
Confused 49.6%
Happy 49.6%
Sad 49.9%
Disgusted 49.8%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%
Angry 49.5%
Calm 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Happy 49.5%
Sad 50.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Angry 49.5%
Sad 50%
Happy 49.5%
Disgusted 49.6%
Calm 49.8%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.6%
Angry 49.5%
Sad 50.3%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.7%
Sad 49.7%
Disgusted 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.5%
Happy 49.7%

AWS Rekognition

Age 10-15
Gender Male, 50%
Sad 50%
Angry 49.6%
Disgusted 49.8%
Surprised 49.5%
Happy 49.6%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 49.6%
Happy 49.6%
Disgusted 50%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.7%

AWS Rekognition

Age 26-44
Gender Male, 50.2%
Happy 49.5%
Sad 50.1%
Confused 49.6%
Calm 49.7%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%

Feature analysis

Amazon

Person 96.8%

Captions

Microsoft

a vintage photo of a painting 75.2%
a painting hanging on a wall 75.1%
a vintage photo of a painting on the wall 67.6%

Text analysis

Amazon

Denison
Boston,
House.
Denison House. Boston, Mass.
Mass.
Beys
Dramatie
Beys Dramatie Chuo
Chuo
G SE 17.61.7.0

Google

LAR
Boys
Denison House, Boston, Mass. LAR Boys Dramotic Club
House,
Club
Denison
Mass.
Boston,
Dramotic