Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs, Northampton, Mass.: One fo the Writing Classes, Room 19

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3096.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: Home-Culture Clubs, Northampton, Mass.: One fo the Writing Classes, Room 19

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.1
Human 99.1
Person 98.8
Person 98.6
Person 98.1
Person 98
Person 97.7
School 97.7
Classroom 97.3
Room 97.3
Indoors 97.3
Person 96.8
Person 95.7
Person 85
People 70.9
Text 70.1
Crowd 68.8
Painting 63.9
Art 63.9
Person 60.2
Teacher 55.2

Clarifai
created on 2019-06-06

people 99.9
many 98.9
group 98.7
man 96.8
child 95.7
education 95.5
adult 95.3
sit 95.2
woman 95
several 93.7
war 93.2
indoors 91.6
leader 91
wear 89.1
administration 88.5
four 88.2
furniture 87.8
elementary school 87.8
room 83.3
group together 82.9

Imagga
created on 2019-06-06

kin 43.9
home 35.1
man 30.2
room 28.5
newspaper 28.3
people 25.6
male 24.1
indoors 22.8
product 20.8
grandfather 20.5
person 20.3
sitting 19.7
smiling 19.5
adult 18.7
couple 18.3
happy 18.2
portrait 18.1
couch 17.4
family 16.9
creation 16.8
indoor 16.4
lifestyle 15.9
happiness 15.7
classroom 15.7
child 15.5
cheerful 15.4
interior 15
relaxing 14.5
women 14.2
smile 12.8
love 12.6
house 12.5
group 12.1
living room 11.7
together 11.4
chair 11.4
color 11.1
father 11
20 24 years 10.8
teacher 10.8
sofa 10.6
computer 10.4
meeting 10.4
senior 10.3
men 10.3
mother 10
face 9.9
old 9.7
two people 9.7
dad 9.6
comfortable 9.5
bed 9.5
living 9.5
adults 9.5
relaxation 9.2
children 9.1
laptop 9.1
vintage 9.1
casual clothing 8.8
table 8.8
females 8.5
business 8.5
togetherness 8.5
two 8.5
lying 8.5
enjoyment 8.4
relationship 8.4
attractive 8.4
mature 8.4
fashion 8.3
holding 8.2
cup 8.1
lady 8.1
parent 8
kid 8
boy 7.8
education 7.8
retired 7.8
full length 7.8
office 7.7
drinking 7.6
daughter 7.6
loving 7.6
resting 7.6
one 7.5
floor 7.4
20s 7.3
girls 7.3
black 7.2
childhood 7.2
little 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

wall 98.9
human face 96.8
person 96.7
clothing 95.7
man 84.3
handwriting 75.4
smile 73
old 60.4
posing 42.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 89.4%
Surprised 4.6%
Sad 56.7%
Disgusted 5.5%
Calm 11.8%
Happy 4.5%
Angry 13.5%
Confused 3.6%

AWS Rekognition

Age 26-43
Gender Male, 81.7%
Calm 67.6%
Disgusted 1.6%
Angry 7.9%
Happy 0.6%
Sad 17.9%
Surprised 1.7%
Confused 2.8%

AWS Rekognition

Age 35-52
Gender Female, 58.6%
Sad 6%
Calm 51.9%
Surprised 13.4%
Confused 6.9%
Disgusted 5.3%
Happy 7.8%
Angry 8.7%

AWS Rekognition

Age 27-44
Gender Male, 98.9%
Angry 5.8%
Happy 2.5%
Disgusted 1.1%
Confused 8.4%
Calm 9.7%
Surprised 3.1%
Sad 69.4%

AWS Rekognition

Age 57-77
Gender Female, 90.7%
Angry 5.1%
Sad 65.9%
Disgusted 2.9%
Calm 3.1%
Surprised 3.3%
Confused 3.2%
Happy 16.4%

AWS Rekognition

Age 27-44
Gender Female, 69.3%
Confused 5.4%
Disgusted 3.1%
Calm 19.6%
Sad 51.7%
Angry 12.7%
Happy 3.4%
Surprised 4.1%

AWS Rekognition

Age 16-27
Gender Male, 51.8%
Angry 49.3%
Disgusted 46.4%
Confused 45.2%
Calm 45.5%
Happy 45.5%
Surprised 45.2%
Sad 47.8%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Disgusted 45.1%
Calm 50.3%
Confused 45.3%
Happy 45.3%
Surprised 45.4%
Angry 45.5%
Sad 48.1%

AWS Rekognition

Age 19-36
Gender Female, 89.8%
Calm 7.8%
Confused 2%
Happy 5.6%
Surprised 1.6%
Angry 3.3%
Disgusted 68.4%
Sad 11.3%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 63.9%

Captions

Microsoft

a group of people posing for a photo 88.1%
a group of people posing for the camera 88%
a group of people sitting posing for the camera 86%

Text analysis

Amazon

the
of
Closses,
writing
One of the writing Closses,
st
One
RCOMI

Google

Writing
of
the
Roomn19
Closses,
One of the Writing Closses, Roomn19
One