Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Elizabeth Peabody House": Elizabeth Peabody House, Boston, Mass.: Cooking Class.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2985.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Elizabeth Peabody House": Elizabeth Peabody House, Boston, Mass.: Cooking Class.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 98.8
Human 98.8
Person 98.5
Person 95.4
Person 94.7
Furniture 88.2
Person 86.2
Indoors 71.8
Pot 71.7
Room 69.9
Clinic 68.9
Dining Table 66
Table 66
Person 63
Person 62.4
Painting 60
Art 60
Meal 58.2
Food 58.2
Plywood 55.3
Wood 55.3

Clarifai
created on 2019-06-06

people 99.9
room 99
furniture 98.1
adult 98
group 96.9
indoors 94.6
child 94.3
man 92.8
wear 91.1
woman 87.5
family 84.7
seat 84.4
administration 84.2
chair 79.9
leader 79.6
one 79.6
many 78.5
table 76.9
container 76.9
two 76.4

Imagga
created on 2019-06-06

room 66.5
interior 58.4
furniture 48.7
home 46.3
house 45.1
decor 25.6
bathroom 25.5
indoors 24.6
modern 24.5
lamp 23.1
table 22.6
apartment 22
box 22
wood 21.7
bedroom 21.4
design 20.8
inside 19.3
living 19
luxury 18
architecture 18
container 17.8
carton 17.6
wall 17.4
decoration 17.4
bath 17.1
window 16.5
comfortable 16.2
hotel 16.2
tub 16.2
relaxation 15.9
chair 15.6
clean 15
floor 14.9
domestic 14.5
bed 14.4
residential 14.4
sofa 14.4
panel 14.1
pillow 13.6
style 13.4
tile 13.1
bathtub 12.4
wooden 12.3
furnishing 12.1
light 11.4
glass 11
indoor 11
comfort 10.6
new 10.5
rest 10.3
kitchen 10.2
relax 10.1
3d 10.1
shelf 9.9
shower 9.9
vessel 9.8
render 9.5
toilet 9.5
nobody 9.3
elegance 9.2
pillows 8.9
couch 8.7
wash 8.7
lifestyle 8.7
sink 8.5
baby bed 8.3
cabinet 8.1
upright 8
towel 7.9
accommodation 7.9
faucet 7.9
cozy 7.9
luxurious 7.8
color 7.8
carpet 7.8
cradle 7.8
old 7.7
mirror 7.6
happy 7.5
warm 7.4
people 7.3
person 7.2
piano 7.2
day 7.1
travel 7

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

table 99
wall 97.2
person 96.7
clothing 96.7
furniture 95.2
indoor 93.4
woman 79.8
old 69.1

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Calm 45.7%
Sad 48.1%
Angry 46.7%
Surprised 45.7%
Disgusted 47%
Confused 45.7%
Happy 46.1%

AWS Rekognition

Age 11-18
Gender Female, 54.4%
Angry 45.1%
Surprised 45.1%
Sad 54.2%
Confused 45.1%
Calm 45.2%
Disgusted 45.1%
Happy 45.2%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Angry 50.9%
Happy 45.1%
Disgusted 46.2%
Confused 45.2%
Calm 45.2%
Surprised 45.1%
Sad 47.3%

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Calm 48.7%
Angry 45.9%
Happy 46.6%
Sad 46.5%
Surprised 45.6%
Confused 45.8%
Disgusted 45.9%

AWS Rekognition

Age 20-38
Gender Female, 53.4%
Disgusted 47%
Surprised 45.8%
Sad 46.9%
Angry 45.7%
Happy 45.3%
Confused 46%
Calm 48.3%

Feature analysis

Amazon

Person 98.8%
Painting 60%

Captions

Microsoft

a vintage photo of some people in a room 91.4%
a vintage photo of a person in a room 90.8%
a vintage photo of a person 79.6%

Text analysis

Amazon

Cooking
Cooking Closs.
Closs.

Google

Cooking Closs
Closs
Cooking