Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Children's Aid Society: "Home Libraries": Home Libraries of the Boston Children's Aid Society, Boston, Mass.: Wild Rose Home Library. Group of Irish Girls in South Boston, meeting on the roof of the librarian's home. Two little girls who had to "mind the babies" brought them to the meetings.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.352

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Children's Aid Society: "Home Libraries": Home Libraries of the Boston Children's Aid Society, Boston, Mass.: Wild Rose Home Library. Group of Irish Girls in South Boston, meeting on the roof of the librarian's home. Two little girls who had to "mind the babies" brought them to the meetings.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.6
Human 99.6
Person 99.3
Person 99.3
Person 99.1
Advertisement 98.7
Poster 98.7
Person 98.6
Person 98.1
Person 98
Person 97.8
Person 97.2
School 97
Person 96.9
Room 96.7
Classroom 96.7
Indoors 96.7
Person 95.2
Person 60.3

Clarifai
created on 2019-06-05

people 99.9
group 99.4
many 98.2
adult 97.4
woman 94.6
man 94.5
child 93.9
group together 93.6
music 93
several 90.6
musician 90.1
leader 90
furniture 89.9
education 87.6
wear 87.3
four 86.4
sit 86.4
room 86.1
administration 85.7
war 84.1

Imagga
created on 2019-06-05

newspaper 51.6
daily 42.8
product 40.4
creation 34.2
money 30.6
currency 28.7
cash 27.4
vintage 25.6
stamp 24.2
dollar 24.1
mail 23.9
postmark 23.6
banking 23
letter 22.9
business 22.5
bill 21.9
bank 21.6
paper 21.2
finance 21.1
envelope 21
postage 20.6
old 20.2
retro 19.7
postal 18.6
dollars 18.3
exchange 18.1
wealth 17.9
financial 17.8
philately 17.8
circa 17.8
ancient 17.3
us 16.4
savings 15.8
card 15.3
symbol 14.8
printed 14.8
hundred 14.5
states 14.5
one 14.2
art 13.9
investment 13.7
close 13.7
aged 13.6
pay 13.4
kin 13.1
rich 13
shows 12.8
message 12.8
man 12.8
bills 12.6
united 12.4
closeup 12.1
grunge 11.9
banknotes 11.7
post 11.4
billboard 11.4
culture 11.1
portrait 11
franklin 10.8
black 10.8
market 10.6
people 10.6
loan 10.5
economy 10.2
global 10
history 9.8
address 9.8
funds 9.8
sign 9.8
finances 9.6
design 9.6
hobby 9.5
signboard 9.2
office 8.8
antique 8.7
notes 8.6
face 8.5
male 8.5
web site 8.4
note 8.3
philatelic 7.9
post office 7.9
masterpiece 7.9
stamps 7.9
wages 7.8
banknote 7.8
payment 7.7
group 7.3
paint 7.2
success 7.2
drawing 7.2
collection 7.2
structure 7.1

Google
created on 2019-06-05

Photograph 95.9
Snapshot 85.5
Room 71.4
Picture frame 64.8
Photography 62.4
Art 58.1
History 57.6
Black-and-white 56.4
Family 54.8
Collection 50

Microsoft
created on 2019-06-05

person 98.5
clothing 97.2
human face 89.1
text 89
posing 86
smile 84.8
black 81.5
old 67.6
group 60.9
newspaper 60.9
woman 59.9
man 53.5
book 50

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Disgusted 49.4%
Confused 45.4%
Surprised 45.3%
Calm 45.9%
Happy 45.5%
Angry 45.8%
Sad 47.7%

AWS Rekognition

Age 20-38
Gender Female, 55%
Angry 45.5%
Confused 46.5%
Calm 46%
Surprised 45.3%
Sad 49.8%
Happy 45.9%
Disgusted 46%

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Confused 45.1%
Surprised 45.1%
Sad 46.6%
Calm 45.5%
Happy 52.4%
Angry 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Sad 51.6%
Calm 46.1%
Disgusted 45.2%
Confused 45.3%
Angry 45.6%
Surprised 45.2%
Happy 45.9%

AWS Rekognition

Age 16-27
Gender Female, 52.9%
Surprised 45.2%
Disgusted 46.8%
Sad 47.3%
Calm 45.3%
Happy 45.2%
Confused 45.2%
Angry 50%

AWS Rekognition

Age 30-47
Gender Female, 53.5%
Confused 45.4%
Disgusted 45.7%
Calm 46.3%
Sad 47.7%
Angry 45.9%
Happy 48.5%
Surprised 45.5%

AWS Rekognition

Age 45-63
Gender Female, 54.2%
Happy 45.5%
Calm 45.6%
Sad 50.5%
Surprised 45.4%
Angry 46.8%
Confused 45.3%
Disgusted 46%

AWS Rekognition

Age 29-45
Gender Male, 54.3%
Calm 45.5%
Surprised 45.3%
Confused 45.9%
Sad 48.1%
Angry 45.6%
Disgusted 45.5%
Happy 49.1%

AWS Rekognition

Age 23-38
Gender Female, 54.6%
Calm 48.5%
Angry 45.3%
Happy 46.5%
Sad 49%
Surprised 45.2%
Confused 45.1%
Disgusted 45.3%

AWS Rekognition

Age 9-14
Gender Female, 53.8%
Happy 45.7%
Sad 53.4%
Surprised 45.1%
Angry 45.3%
Calm 45.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 53.1%
Disgusted 45.2%
Sad 53.8%
Calm 45.1%
Surprised 45.1%
Angry 45.6%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 12-22
Gender Male, 50.8%
Sad 52.8%
Disgusted 45%
Angry 45.3%
Surprised 45.1%
Calm 46.7%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 1-5
Gender Female, 54.1%
Angry 47.3%
Surprised 45.3%
Calm 45.6%
Happy 45.2%
Confused 45.4%
Disgusted 45.5%
Sad 50.7%

AWS Rekognition

Age 6-13
Gender Female, 51.8%
Angry 45.3%
Disgusted 45.2%
Sad 49.4%
Calm 49.7%
Happy 45.2%
Surprised 45.1%
Confused 45.2%

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Poster 98.7%

Captions

Microsoft

a group of people posing for a photo 88.1%
an old photo of a group of people posing for the camera 85.1%
a group of people posing for the camera 85%

Text analysis

Amazon

Libraries
Home
Children's
Boston
the Society, Home Boston Children's Aid Boston, Libraries of
Mass.
Boston,
Society,
the
Aid
of
Library.
had
Rose
Hom
Tild Rose Hom Library.
had brought then
brought
then
Croun
Irish
Tild
Croun Irish pirle Boaton.
Boaton.
pirle

Google

Library.
meeting
11brarian
ild Rose Hom Library. soaton, meeting on b the roof of the 11brarian Home Libraries of the Boston Children's Aid Society, Boston, Mass. G Se ig 51
on
roof
the
Home
Boston
Aid
Mass.
ild
Rose
Libraries
Boston,
G
ig
Hom
Children's
Se
51
soaton,
b
of
Society,