Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "The Home Culture Clubs": The Home Culture Clubs, Northampton, Mass.: Dressmaking Classes. Home-Culture Clubs.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.420.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "The Home Culture Clubs": The Home Culture Clubs, Northampton, Mass.: Dressmaking Classes. Home-Culture Clubs.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.420.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.8
Human 99.8
Person 99.7
Person 99.5
Person 99.4
Person 99.2
School 94.6
Classroom 93.1
Indoors 93.1
Room 93.1
People 90.1
Person 89.3
Kindergarten 70
Painting 67.9
Art 67.9
Person 62.9
Workshop 59.6

Clarifai
created on 2019-06-05

people 99.9
group 99.8
child 99.7
group together 98.6
many 98.4
adult 97.9
boy 97.3
education 96.5
wear 96.2
school 95.4
several 95.3
room 94.3
man 92.5
five 90.7
elementary school 89.4
furniture 88.8
classroom 88.4
war 86.1
woman 85.4
facial expression 85.3

Imagga
created on 2019-06-05

man 39.7
kin 38.4
home 38.3
people 36.3
couple 35.7
child 35.4
male 35.1
family 33.8
mother 33.2
happy 30.7
smiling 30.4
room 29.2
happiness 29
together 27.2
adult 26.7
person 25.6
indoors 25.5
senior 24.4
father 24
cheerful 22.8
sitting 22.3
husband 22.2
love 21.3
parent 19.3
women 18.2
mature 17.7
boy 17.4
lifestyle 17.4
grandfather 17.3
smile 17.1
daughter 16.8
portrait 16.2
wife 16.1
son 16
30s 15.4
married 15.3
elderly 15.3
kid 15.1
hospital 15
men 14.6
group 14.5
fun 14.2
two 13.6
dad 13.2
children 12.8
40s 12.7
retired 12.6
living 12.3
friends 12.2
day 11.8
sibling 11.8
living room 11.8
nurse 11.6
couch 11.6
sofa 11.5
classroom 11.3
teacher 11.3
groom 11.2
indoor 11
care 10.7
face 10.7
mid adult 10.6
retirement 10.6
talking 10.5
casual 10.2
horizontal 10
holding 9.9
childhood 9.9
grandmother 9.8
old 9.8
enjoying 9.5
togetherness 9.4
meeting 9.4
relaxed 9.4
relationship 9.4
friendship 9.4
joy 9.2
20s 9.2
relaxing 9.1
health 9
color 8.9
thirties 8.8
mom 8.7
patient 8.7
table 8.7
cute 8.6
loving 8.6
enjoyment 8.4
house 8.4
playing 8.2
laptop 8.2
professional 8
celebration 8
businessman 7.9
medical 7.9
business 7.9
four people 7.9
forties 7.8
bride 7.8
60s 7.8
education 7.8
discussion 7.8
hug 7.7
drinking 7.7
occupation 7.3
girls 7.3
life 7.3
businesswoman 7.3
office 7.2
dress 7.2
computer 7.2
romance 7.1
interior 7.1
pensioner 7.1
little 7.1

Google
created on 2019-06-05

Photograph 97
People 96.4
Snapshot 88.2
Room 74.4
Family 68.1
Photography 67.8
Stock photography 64
Child 61.3
Art 58.1

Microsoft
created on 2019-06-05

wall 99.5
clothing 99
person 98.5
human face 98.5
smile 90.5
posing 77.6
woman 74.9
child 74.8
man 72.1
group 68.7
old 58.4
boy 58.3
baby 50.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-27
Gender Female, 64.9%
Sad 58.3%
Confused 2.7%
Surprised 1.8%
Happy 0.9%
Angry 25.2%
Disgusted 2.1%
Calm 9%

AWS Rekognition

Age 30-47
Gender Female, 85.2%
Surprised 2.1%
Disgusted 3.3%
Sad 63.2%
Calm 24.2%
Happy 1.5%
Confused 1.7%
Angry 4%

AWS Rekognition

Age 35-52
Gender Female, 52.6%
Surprised 45.1%
Disgusted 45.1%
Sad 53.2%
Calm 46.3%
Confused 45.1%
Angry 45.1%
Happy 45.1%

AWS Rekognition

Age 38-59
Gender Male, 82.2%
Calm 1%
Happy 1.2%
Sad 17.3%
Angry 6.4%
Confused 2.8%
Disgusted 70.1%
Surprised 1.3%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 67.9%