Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: The Cooking Classes. Home-Culture Clubs, James House

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3094.1

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: The Cooking Classes. Home-Culture Clubs, James House

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.5
Human 99.5
Person 99.4
Person 98.3
Restaurant 97.2
Meal 95.6
Food 95.6
Person 95.4
Person 87.5
Cafeteria 81.9
Female 71.2
Worker 70.2
Clothing 69.4
Apparel 69.4
Woman 62.6
Home Decor 58.3
Diner 57.1

Clarifai
created on 2019-06-06

people 99.9
group 98.9
group together 98.9
adult 98.9
several 97.1
two 96.8
furniture 96.8
man 96.6
three 96.5
scientist 96.2
four 94.3
five 93.8
many 92.7
wear 91.3
woman 90.6
watercraft 89.8
military 89.7
administration 89.2
vehicle 89.1
leader 86.5

Imagga
created on 2019-06-06

barbershop 41.5
interior 38
counter 36.5
shop 34.6
room 33.6
home 32.7
chair 30.5
furniture 28
kitchen 26.2
house 25.9
mercantile establishment 25.3
indoors 22.8
modern 22.4
table 22.2
salon 21.9
barber chair 18.8
decor 17.7
sink 17
place of business 17
hairdresser 16.8
restaurant 16.4
man 16.1
lifestyle 15.9
luxury 15.4
people 14.5
mirror 14.3
design 14.1
bathroom 13.7
male 13.5
apartment 13.4
clean 13.4
architecture 13.3
seat 13
floor 12.1
inside 12
indoor 11.9
decoration 11.6
family 11.6
cooking 11.3
person 11
glass 10.9
cabinet 10.8
tile 10.6
medical 10.6
adult 10.4
bath 10.4
sitting 10.3
women 10.3
work 10.2
smiling 10.1
domestic 10.1
light 10
clinic 9.9
faucet 9.8
comfortable 9.5
elegant 9.4
happy 9.4
relaxation 9.2
food 9.2
style 8.9
dinner 8.8
expensive 8.6
residential 8.6
hotel 8.6
estate 8.5
mother 8.5
establishment 8.5
elegance 8.4
coffee 8.3
holding 8.2
window 8.2
office 8.2
patient 8.1
couple 7.8
shower 7.8
men 7.7
wall 7.7
hospital 7.7
lamp 7.6
two 7.6
dining 7.6
wood 7.5
service 7.4
care 7.4
new 7.3
life 7.2
portrait 7.1
happiness 7
together 7

Google
created on 2019-06-06

Photograph 96.1
Snapshot 87.6
Room 83.1
Photography 67.8
Table 58.6
Vintage clothing 57
Art 50.2

Microsoft
created on 2019-06-06

wall 99.6
indoor 99.4
clothing 97.2
person 95.8
table 87.8
old 87
man 81
kitchen 74.4
human face 54.8
posing 47.2
cooking 20.7

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Female, 52.9%
Confused 45.4%
Disgusted 45.7%
Angry 46.4%
Calm 45.3%
Sad 51.7%
Happy 45.3%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Sad 47.9%
Confused 46.2%
Calm 47.3%
Disgusted 45.6%
Angry 45.4%
Surprised 46.8%
Happy 45.8%

AWS Rekognition

Age 16-27
Gender Male, 79.7%
Disgusted 10.6%
Calm 31%
Confused 6.2%
Happy 16%
Surprised 9.2%
Angry 9.5%
Sad 17.6%

Microsoft Cognitive Services

Age 21
Gender Female

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 84.8%
a group of people standing in a kitchen 84.7%
a group of people in a kitchen 84.6%

Text analysis

Amazon

ia