Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Ellis Memorial and Eldridge House": Ellis Memorial and Eldridge House, Boston, Mass.: Club and Class Groups. Carver Street.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3014

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Ellis Memorial and Eldridge House": Ellis Memorial and Eldridge House, Boston, Mass.: Club and Class Groups. Carver Street.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3014

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Interior Design 99.9
Indoors 99.9
Person 98.9
Human 98.9
Person 97.8
Room 96.5
Person 95.8
Person 95.1
Crowd 94.2
Person 92.1
Person 91.6
Theater 91.5
Person 90.1
Person 89.7
Person 89.3
Musician 85
Musical Instrument 85
Person 83.9
Person 83.7
Poster 81.8
Advertisement 81.8
Person 77.8
Person 77.5
Person 77.4
Collage 76.2
Person 74.7
Person 73.5
Person 73
Concert 72.9
Text 72.7
Person 71.7
Person 70.7
Person 70
Person 67.9
Person 66.5
Person 66.4
Person 65.8
Person 61.3
Leisure Activities 61.2
Person 61
Music Band 60.6
Person 58.6
Orchestra 58.3
Person 53.3
Person 51.5

Clarifai
created on 2019-06-06

no person 99.2
people 98.7
museum 95.7
print 94.8
adult 94.6
man 94.3
illustration 93.5
group 93.4
art 92.5
many 92.3
outdoors 91.5
woman 91.3
retro 90.7
picture frame 90.4
painting 90.3
exhibition 89.4
travel 88.6
collection 88.5
portrait 88.2
indoors 86.7

Imagga
created on 2019-06-06

blackboard 40
web site 36.8
negative 30.9
film 26.5
grunge 22.1
vintage 20.7
old 19.5
building 19.4
structure 17.5
architecture 17.3
retro 16.4
antique 15.6
photographic paper 15.3
texture 15.3
city 15
case 14.7
text 14
paint 13.6
dirty 13.5
business 13.4
paper 13.3
black 13.2
pattern 13
design 12.9
money 12.8
finance 12.7
currency 12.6
dollar 12.1
art 11.7
bill 11.4
drawing 11.1
winter 11.1
cash 11
graphic 10.9
house 10.9
snow 10.8
frame 10.8
bank 10.7
tower 10.7
history 10.7
us 10.6
damaged 10.5
grungy 10.4
photographic equipment 10.2
border 9.9
hundred 9.7
urban 9.6
landscape 8.9
shop 8.8
memorial 8.8
collage 8.7
scene 8.6
pay 8.6
exterior 8.3
sky 8.3
landmark 8.1
digital 8.1
billboard 8.1
light 8
financial 8
scratches 7.9
photographic 7.8
frames 7.8
scratch 7.8
space 7.8
sell 7.7
rust 7.7
edge 7.7
office 7.6
skyline 7.6
cityscape 7.6
sign 7.5
facade 7.5
symbol 7.4
signboard 7.4
banking 7.3
letter 7.3
rough 7.3
brass 7.3
aged 7.2
color 7.2
computer 7.2
material 7.1
trees 7.1
gymnasium 7.1
night 7.1
modern 7

Google
created on 2019-06-06

Photograph 96.3
Text 91.9
Collection 83.3
Snapshot 83.3
Photograph album 72.4
Photographic paper 71.7
Room 71.4
Album 70.5
Photography 67.8
History 64.5
Art 62.5
Paper product 50.3

Microsoft
created on 2019-06-06

scene 99.5
room 98.7
gallery 96.7
person 92
picture frame 50.7
old 40.8
different 34.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-45
Gender Male, 50.2%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Angry 49.6%
Sad 50.3%

AWS Rekognition

Age 11-18
Gender Male, 50.4%
Angry 49.6%
Calm 49.6%
Disgusted 49.5%
Surprised 49.5%
Sad 50.2%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 48-68
Gender Female, 50.5%
Confused 49.6%
Calm 49.6%
Disgusted 49.6%
Sad 50%
Happy 49.6%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 14-23
Gender Male, 50.4%
Sad 50.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Happy 49.7%
Sad 49.7%
Disgusted 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.7%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50%
Angry 49.7%
Surprised 49.5%
Disgusted 49.5%
Calm 49.9%
Sad 49.7%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Disgusted 49.5%
Surprised 49.5%
Sad 50%
Angry 49.6%
Happy 49.5%
Confused 49.5%
Calm 49.9%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Surprised 49.6%
Happy 49.6%
Calm 49.7%
Disgusted 49.8%
Confused 49.7%
Sad 49.7%
Angry 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Sad 49.8%
Calm 50%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Calm 49.7%
Disgusted 49.5%
Surprised 49.6%
Confused 49.6%
Angry 49.5%
Sad 49.6%
Happy 50%

AWS Rekognition

Age 16-27
Gender Female, 50.3%
Disgusted 49.9%
Calm 49.8%
Confused 49.6%
Happy 49.5%
Surprised 49.5%
Angry 49.6%
Sad 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.3%
Calm 49.8%
Happy 49.6%
Sad 49.8%
Angry 49.7%
Confused 49.6%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50%
Sad 49.7%
Angry 49.7%
Happy 49.6%
Disgusted 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Surprised 49.6%
Calm 49.5%
Happy 49.7%
Angry 49.6%
Sad 49.5%
Disgusted 50%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Happy 49.5%
Angry 49.6%
Calm 49.6%
Sad 49.6%
Surprised 49.6%
Confused 49.6%
Disgusted 50.1%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Angry 49.6%
Disgusted 49.6%
Surprised 49.5%
Calm 49.6%
Sad 50%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 17-27
Gender Male, 50.5%
Surprised 49.5%
Angry 50.3%
Sad 49.6%
Happy 49.5%
Disgusted 49.5%
Calm 49.5%
Confused 49.6%

AWS Rekognition

Age 6-13
Gender Male, 50.3%
Sad 50.3%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.6%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Angry 49.7%
Sad 50.1%
Disgusted 49.6%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Confused 49.6%
Happy 49.5%
Surprised 49.5%
Calm 50%
Angry 49.6%
Sad 49.7%
Disgusted 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.7%
Angry 50.1%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 49.8%
Angry 49.7%
Calm 49.7%
Confused 49.7%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 14-23
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.8%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Sad 49.9%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Sad 49.8%
Confused 49.6%
Surprised 49.6%
Happy 49.7%
Angry 49.7%
Disgusted 49.6%
Calm 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Calm 49.7%
Sad 49.8%
Happy 49.5%
Confused 49.6%
Angry 49.7%
Surprised 49.6%
Disgusted 49.7%

AWS Rekognition

Age 17-27
Gender Female, 50.1%
Happy 49.5%
Sad 50.2%
Disgusted 49.6%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.5%
Sad 50.1%
Calm 49.5%
Confused 49.5%
Angry 49.5%
Happy 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Angry 49.7%
Sad 50%
Disgusted 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Happy 49.5%

AWS Rekognition

Age 11-18
Gender Male, 50%
Happy 49.5%
Sad 49.6%
Angry 50%
Surprised 49.6%
Calm 49.6%
Confused 49.6%
Disgusted 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.6%
Disgusted 49.6%
Surprised 49.5%
Calm 49.6%
Sad 50%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.4%
Angry 49.5%
Surprised 49.5%
Calm 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 50.4%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Confused 49.5%
Calm 49.7%
Disgusted 49.6%
Sad 49.6%
Happy 49.8%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 17-27
Gender Male, 50.3%
Disgusted 49.6%
Confused 49.6%
Surprised 49.6%
Calm 49.7%
Happy 49.8%
Angry 49.6%
Sad 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 49.5%
Sad 50.4%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 49.9%
Sad 49.9%
Happy 49.5%
Confused 49.6%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.7%
Disgusted 49.5%
Calm 49.6%
Surprised 49.6%
Happy 49.7%
Sad 49.8%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Surprised 49.5%
Happy 49.5%
Calm 49.9%
Disgusted 49.7%
Confused 49.6%
Sad 49.7%
Angry 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Calm 49.6%
Disgusted 49.6%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.1%
Angry 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Calm 49.6%
Happy 49.5%
Sad 49.6%
Angry 49.9%
Disgusted 49.6%
Confused 49.8%
Surprised 49.6%

AWS Rekognition

Age 4-9
Gender Female, 50.5%
Angry 49.6%
Sad 49.7%
Calm 49.8%
Disgusted 49.5%
Happy 49.8%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Confused 49.6%
Sad 49.9%
Disgusted 49.5%
Angry 49.6%
Happy 49.6%
Calm 49.9%
Surprised 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Surprised 49.5%
Sad 49.7%
Disgusted 49.6%
Happy 49.6%
Confused 49.5%
Calm 49.9%
Angry 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Surprised 49.5%
Happy 49.6%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.7%
Angry 50.1%

Feature analysis

Amazon

Person
Poster
Person 98.9%
Person 97.8%
Person 95.8%
Person 95.1%
Person 92.1%
Person 91.6%
Person 90.1%
Person 89.7%
Person 89.3%
Person 83.9%
Person 83.7%
Person 77.8%
Person 77.5%
Person 77.4%
Person 74.7%
Person 73.5%
Person 73%
Person 71.7%
Person 70.7%
Person 70%
Person 67.9%
Person 66.5%
Person 66.4%
Person 65.8%
Person 61.3%
Person 61%
Person 58.6%
Person 53.3%
Person 51.5%
Poster 81.8%

Categories

Imagga

streetview architecture 93.9%
interior objects 4.9%

Captions

Microsoft
created on 2019-06-06

a display in a room 62%
an old photo of a person 27.2%
old photo of a person 25.4%

Text analysis

Amazon

Eldridge
Memorial
and
Mass.
Boston,
Elis Memorial and Eldridge House. Boston, Mass.
House.
Elis
Gros
Clos
Clus and Clos Gros
Carvo
Clus

Google

Ellis Memorial and Eldridge House, Boston, Mass. G S Club and Class GrrouEN Carvee sdneet
Ellis
Memorial
and
Eldridge
House,
Boston,
Mass.
G
S
Club
Class
GrrouEN
Carvee
sdneet