Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. 'The Home Culture Clubs": The Home Culture Clubs, Northampton, Mass.: Dressmaking Classes. Home-Culture Clubs.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.420.4

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. 'The Home Culture Clubs": The Home Culture Clubs, Northampton, Mass.: Dressmaking Classes. Home-Culture Clubs.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.420.4

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.5
Person 99.5
Person 99.3
Person 98.7
Person 98.6
Person 94.2
Person 93.8
Art 81.1
Painting 81.1
Room 77.3
Indoors 77.3
Restaurant 74.6
Sitting 73.7
Furniture 64.9
Couch 57.9
Classroom 56.7
School 56.7
Worker 55.9
Workshop 55.8

Clarifai
created on 2019-06-05

people 99.9
group 99.5
adult 99.2
group together 97.5
furniture 97.4
man 97.3
woman 96.9
room 96.7
administration 95
several 94.8
child 94.3
sit 93.6
desk 92
two 91.9
facial expression 91.6
leader 89
three 88.8
five 88.8
four 87.4
war 86.1

Imagga
created on 2019-06-05

people 41.3
kin 40.7
home 35.9
couple 34.8
man 34.3
adult 32.2
male 31.5
indoors 29.9
person 29.4
happy 26.9
room 25.6
smiling 24.6
happiness 24.3
mother 23.6
family 23.1
lifestyle 22.4
women 22.1
senior 21.6
sitting 21.5
love 21.3
cheerful 21.1
together 20.1
mature 19.5
smile 19.2
grandma 17.8
portrait 16.8
husband 16.6
indoor 16.4
men 15.5
fun 15
face 14.9
child 14.9
retired 14.5
sibling 14.5
wife 14.2
teacher 14.1
two 13.5
attractive 13.3
togetherness 13.2
parent 13.2
relationship 13.1
laptop 12.9
elderly 12.4
loving 12.4
daughter 12.3
classroom 12.2
group 12.1
computer 12.1
casual 11.9
blond 11.8
older 11.6
leisure 11.6
retirement 11.5
interior 11.5
enjoying 11.4
boy 11.3
table 11.2
sexy 11.2
looking 11.2
pretty 11.2
old 11.1
holding 10.7
romance 10.7
fashion 10.6
lady 10.5
married 10.5
meeting 10.4
friends 10.3
father 10.2
horizontal 10
drink 10
relaxing 10
pensioner 9.9
romantic 9.8
couch 9.7
drinking 9.6
education 9.5
hair 9.5
living 9.5
relaxed 9.4
enjoyment 9.4
groom 9.3
care 9.1
aged 9
grandfather 9
technology 8.9
living room 8.8
chair 8.6
work 8.6
day 8.6
bride 8.6
sofa 8.6
clothing 8.6
sit 8.5
business 8.5
friendship 8.4
professional 8.3
playing 8.2
dress 8.1
student 8.1
life 8
holiday 7.9
musical instrument 7.9
bright 7.9
60s 7.8
hug 7.7
partner 7.7
mid adult 7.7
age 7.6
educator 7.6
laughing 7.6
pair 7.6
tea 7.5
alcohol 7.4
wine 7.4
inside 7.4
wedding 7.4
son 7.3
color 7.2
worker 7.2
cute 7.2
handsome 7.1
kid 7.1
to 7.1
working 7.1
stringed instrument 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

wall 99.3
person 98.4
clothing 96.7
indoor 91.1
human face 72.7
woman 70.6
old 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 88.4%
Sad 54.3%
Angry 10.7%
Happy 3.1%
Disgusted 4.1%
Calm 20.7%
Surprised 3.6%
Confused 3.4%

AWS Rekognition

Age 19-36
Gender Female, 78.5%
Angry 11.6%
Calm 13.9%
Sad 48.2%
Surprised 5%
Disgusted 11.1%
Happy 3.1%
Confused 7.2%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Surprised 45.6%
Disgusted 46.6%
Sad 47.5%
Calm 47.4%
Happy 45.8%
Confused 45.9%
Angry 46.3%

AWS Rekognition

Age 14-23
Gender Male, 53.7%
Angry 47.3%
Calm 49.8%
Confused 45.4%
Happy 45.3%
Sad 46.1%
Disgusted 45.5%
Surprised 45.7%

AWS Rekognition

Age 19-36
Gender Male, 50.3%
Calm 45.3%
Sad 53%
Surprised 45.1%
Angry 46.1%
Happy 45.1%
Confused 45.2%
Disgusted 45.2%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 81.1%

Categories

Captions

Microsoft
created on 2019-06-05

an old photo of a person 83.1%
old photo of a person 82.7%
an old photo of a person 77.3%