Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Children's Aid Society: Home Libraries: Home Libraries of the Boston Children's Aid Society, Boston, Mass.: Garibaldi Home Library. Italian boys of the North End. Most of them work, and they meet in the evening.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.194

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Children's Aid Society: Home Libraries: Home Libraries of the Boston Children's Aid Society, Boston, Mass.: Garibaldi Home Library. Italian boys of the North End. Most of them work, and they meet in the evening.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.4
Person 99.4
Person 99.2
Person 97.5
Person 96.4
Person 94.9
Person 92.8
Person 91.4
Person 89.6
Advertisement 82.7
Room 76.2
Indoors 76.2
Person 75
Person 71.4
Text 70.8
School 68.9
Classroom 68.9
Person 66.3
Paper 65.5
Flyer 65.5
Brochure 65.5
Person 64.7
Crowd 63.4
Poster 59.1
Art 58.6
People 57.7
Person 54.9

Clarifai
created on 2019-06-05

people 99.8
group 97.9
adult 96.9
man 95.1
woman 94.1
child 94.1
wear 92.1
room 91.9
many 90.3
furniture 89.7
military 87.1
administration 86.1
indoors 84
leader 83.1
war 83
group together 82.1
music 81.7
family 80.6
several 80.1
one 77.5

Imagga
created on 2019-06-05

classroom 61.1
room 57.2
people 24
man 22.8
person 21
male 19.1
old 16.7
business 16.4
home 15.9
office 15.4
vintage 14
teacher 12.5
group 12.1
building 11.7
interior 11.5
men 11.1
indoor 10.9
black 10.8
family 10.7
retro 10.6
indoors 10.5
ancient 10.4
portrait 10.3
senior 10.3
aged 9.9
board 9.9
shop 9.7
antique 9.7
couple 9.6
education 9.5
women 9.5
student 9.2
modern 9.1
businessman 8.8
smiling 8.7
adult 8.7
barbershop 8.3
back 8.3
human 8.2
window 8.1
newspaper 8
chair 8
working 7.9
postmark 7.9
postage 7.9
postal 7.8
stamp 7.7
class 7.7
mail 7.7
post 7.6
finance 7.6
school 7.6
communication 7.5
house 7.5
silhouette 7.4
letter 7.3
blackboard 7.3
brass 7.3
art 7.2
love 7.1
work 7.1
travel 7

Google
created on 2019-06-05

Photograph 96.2
Text 85.2
Snapshot 84.9
Picture frame 70
Room 65.7
Photography 62.4
History 54.1
Art 50.2

Microsoft
created on 2019-06-05

person 97.8
clothing 97.5
posing 90.8
man 85.8
indoor 85.5
human face 83.1
library 72
gallery 67.5
group 67.3
people 62
smile 53.7
room 49.1
store 44.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Female, 53.1%
Angry 45.5%
Surprised 45.2%
Sad 46.4%
Confused 45.3%
Calm 52.1%
Disgusted 45.3%
Happy 45.1%

AWS Rekognition

Age 14-23
Gender Male, 51.8%
Sad 50%
Angry 45.3%
Happy 45.1%
Surprised 45.1%
Confused 45.2%
Calm 49.1%
Disgusted 45.1%

AWS Rekognition

Age 6-13
Gender Female, 53.9%
Disgusted 45.3%
Confused 45.2%
Happy 47.8%
Calm 50.4%
Surprised 45.6%
Sad 45.4%
Angry 45.2%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Confused 49.5%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Sad 50.5%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 4-9
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 10-15
Gender Female, 53.3%
Confused 45.1%
Surprised 45.1%
Sad 54.2%
Calm 45.2%
Happy 45.1%
Angry 45.1%
Disgusted 45.1%

AWS Rekognition

Age 10-15
Gender Female, 54.6%
Happy 45.1%
Disgusted 45.3%
Sad 49.7%
Surprised 45.1%
Confused 45.2%
Calm 47.9%
Angry 46.8%

AWS Rekognition

Age 35-53
Gender Male, 50.1%
Calm 49.8%
Happy 49.5%
Confused 49.5%
Sad 50.1%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.2%
Calm 49.6%
Surprised 49.5%
Confused 49.5%
Sad 50.3%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Calm 49.5%
Happy 49.5%
Sad 49.6%
Angry 50.3%
Confused 49.5%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Male, 50.2%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.6%
Sad 50.3%
Angry 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Angry 49.5%
Calm 49.6%
Sad 50.4%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 12-22
Gender Female, 50.4%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.4%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Calm 49.6%
Sad 50.1%
Surprised 49.6%
Angry 49.6%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Happy 49.5%
Sad 49.5%
Disgusted 49.5%
Surprised 50.4%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Calm 49.5%
Sad 49.6%
Angry 50.3%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Angry 49.6%
Calm 49.7%
Sad 49.6%
Surprised 49.6%
Disgusted 49.6%
Happy 49.9%
Confused 49.6%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 59.1%

Captions

Microsoft

a group of people posing for a photo in front of a store 86.8%
a group of people posing for a photo 86.7%
a group of people posing for a photo in front of a box 86.1%

Text analysis

Amazon

Aid
Boston
the
Home
Libraries
Children's
Home Libraries of the Boston Children's Aid Society, Boston, Mass.
Boston,
Mass.
of
Society,
Carthaldi
Carthaldi Lbrery.
Lbrery.
Mst

Google

Home
Libraries
of
and
Boston
Mass.
G
Sea
the
Society,
Garthaldi
Library
boy,
orth
toat
werk.
est
erentng
Aid
nd
than
they
in
Home Libraries of the Boston Children's Aid Society, Boston, Mass. G Sea Garthaldi Home Library Italian boy, of the orth nd toat of than werk. and they est in the erentng
Children's
Boston,
Italian