Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: The Cooking Classes. Home-Culture Clubs, James House
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3094.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Northampton. "Home Culture Club": The Home Culture Clubs, Northampton, Mass.: The Cooking Classes. Home-Culture Clubs, James House

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3094.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.8
Human 99.8
Person 97.3
Person 95.6
Person 86.4
Restaurant 77.5
Lab 76.6
Cafeteria 70.1
Person 66.8
Musical Instrument 66.6
Leisure Activities 66.6
Piano 66.6
Cafe 55.3
Chef 55

Clarifai
created on 2019-06-06

people 100
group 99.5
group together 99
adult 98.7
furniture 97.6
administration 97.3
man 96.8
many 96.2
several 95.6
leader 95.5
chair 94.8
instrument 94.2
medical practitioner 93.3
seat 93
wear 92.7
sit 92.3
four 91.5
military 91.4
music 91.2
woman 90.8

Imagga
created on 2019-06-06

percussion instrument 60
musical instrument 58
stringed instrument 38.7
kettle 38.3
piano 29.3
interior 29.2
grand piano 26.2
table 24
room 24
chair 22.8
device 22.4
house 21.7
keyboard instrument 21.4
furniture 19
bowed stringed instrument 17.9
home 16.7
window 16.5
cello 15.6
modern 15.4
decor 15
luxury 14.6
architecture 14
indoors 14
wall 13.7
sitting 12.9
glass 12.4
design 12.4
decoration 12.3
old 11.8
comfortable 11.5
building 11.4
style 11.1
floor 10.2
kitchen 10
wood 10
handcart 9.7
living 9.5
man 9.4
lifestyle 9.4
male 9.2
inside 9.2
indoor 9.1
people 8.9
sax 8.9
shopping cart 8.4
shop 8.4
seat 8.3
upright 8.2
women 7.9
travel 7.7
empty 7.7
elegant 7.7
residential 7.7
lamp 7.6
elegance 7.5
city 7.5
wheeled vehicle 7.4
business 7.3
office 7.2

Google
created on 2019-06-06

Photograph 95.3
Snapshot 82.9
Room 82.6
Table 67.2
Stock photography 65.4
Furniture 59.4
Art 58.1
History 57.6
Classic 56.7
Interior design 54.3

Microsoft
created on 2019-06-06

indoor 96.8
furniture 95.6
clothing 91.6
table 90.1
person 89.8
old 78.5
chair 65.8
man 62.2

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Surprised 45%
Happy 45%
Calm 45.8%
Disgusted 45.1%
Confused 45.1%
Sad 53.8%
Angry 45.2%

AWS Rekognition

Age 23-38
Gender Female, 53%
Confused 45.2%
Calm 46.5%
Disgusted 45.3%
Sad 45.5%
Happy 45%
Angry 52.3%
Surprised 45.1%

AWS Rekognition

Age 29-45
Gender Female, 50.4%
Disgusted 47.3%
Happy 45.3%
Angry 45.8%
Calm 49.1%
Surprised 45.3%
Confused 45.3%
Sad 46.9%

AWS Rekognition

Age 30-47
Gender Male, 78.4%
Sad 4%
Angry 3.2%
Disgusted 0.5%
Surprised 1.2%
Happy 5.7%
Calm 83.5%
Confused 1.8%

Microsoft Cognitive Services

Age 26
Gender Male

Feature analysis

Amazon

Person 99.8%
Piano 66.6%

Categories

Imagga

interior objects 93.3%
food drinks 3.4%
cars vehicles 2.3%

Captions

Microsoft
created on 2019-06-06

a vintage photo of a person 82.9%
a vintage photo of a kitchen 81.7%
an old photo of a person 81.6%