Human Generated Data

Title

Social Settlements: United States. Massachusetts. Cambridge. "Neighborhood House": Neighborhood House, Cambridge, Mass.: Basket Making.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3073.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Cambridge. "Neighborhood House": Neighborhood House, Cambridge, Mass.: Basket Making.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3073.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 98.9
Human 98.9
Person 98
Indoors 94.7
Room 94.7
Wood 89.4
Flooring 87
Plywood 85.6
Sitting 85.4
Furniture 84.9
Couch 84.9
Person 83.4
Living Room 81.5
Chair 80.4
Person 80.2
Interior Design 76.4
Chair 76.3
School 69.7
Classroom 69.7
Person 68
People 66.8
Painting 63.7
Art 63.7
Food 60
Meal 57.3
Hardwood 56.5
Floor 56.5
Restaurant 55.4
Workshop 55.3

Clarifai
created on 2019-06-06

people 100
group 98.9
adult 98.2
child 98
furniture 97.5
administration 95.5
room 95.5
several 95.1
group together 94.9
two 93.2
many 93
four 92.9
man 92.7
five 91.7
chair 90.8
leader 90.8
woman 90.6
three 88.9
offspring 87.6
medical practitioner 87.4

Imagga
created on 2019-06-06

room 52.9
interior 41.6
home 40.7
table 32.7
indoors 27.2
furniture 27.2
house 26.7
chair 25.9
person 20.6
hospital 20
people 17.8
bedroom 17.7
man 16.8
bed 16.1
indoor 15.5
modern 15.4
adult 15.4
apartment 15.3
comfortable 15.3
living 15.2
inside 14.7
design 14.6
luxury 14.6
couch 14.5
lifestyle 14.5
decor 14.1
chairs 13.7
happiness 13.3
sofa 13.1
smiling 13
window 12.8
domestic 12.8
desk 12.6
happy 12.5
sitting 12
cup 11.8
wood 11.7
family 11.6
male 11.3
architecture 10.9
hotel 10.5
kitchen 10.5
women 10.3
classroom 10
wall 10
child 9.7
love 9.5
light 9.4
coffee 9.3
cheerful 8.9
living room 8.8
life 8.8
pillow 8.7
glass 8.7
sketch 8.7
business 8.5
floor 8.4
color 8.3
office 8.3
student 8.3
kid 8
to 8
together 7.9
couple 7.8
lamp 7.8
shelf 7.8
residential 7.7
elegance 7.6
seat 7.4
20s 7.3
relaxing 7.3
food 7.3
teacher 7.2
computer 7.2
smile 7.1
drawing 7.1
wooden 7

Google
created on 2019-06-06

Photograph 95.5
Room 86.1
Snapshot 84.3
Table 77.5
Furniture 72.1
Adaptation 67
Photography 62.4
Stock photography 59.4
History 57.6
Family 56.6
Sitting 54.1
Games 52.1
Illustration 50.4

Microsoft
created on 2019-06-06

table 99.4
furniture 96.8
clothing 91.9
person 91.8
house 81.4
chair 79.9
man 76.6
old 76.5
white 64.4
family 50.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 11-18
Gender Female, 51.5%
Calm 49.2%
Sad 50.2%
Surprised 45.1%
Angry 45.2%
Happy 45.1%
Confused 45.1%
Disgusted 45.2%

AWS Rekognition

Age 19-36
Gender Female, 54.5%
Angry 45.9%
Confused 45.4%
Calm 46.8%
Surprised 45.5%
Sad 50.7%
Happy 45.3%
Disgusted 45.4%

AWS Rekognition

Age 35-52
Gender Male, 98.3%
Happy 7.1%
Calm 46%
Sad 7.4%
Surprised 6.1%
Angry 8.2%
Confused 7%
Disgusted 18.2%

AWS Rekognition

Age 23-38
Gender Female, 52.5%
Angry 45.2%
Calm 45.2%
Disgusted 45.1%
Surprised 45.1%
Sad 54.1%
Happy 45.2%
Confused 45.1%

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Sad 47.3%
Disgusted 47.6%
Calm 46.4%
Confused 45.9%
Happy 46.3%
Surprised 45.6%
Angry 45.9%

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Surprised 45.4%
Disgusted 49.1%
Angry 46.5%
Sad 45.6%
Happy 46.2%
Confused 45.4%
Calm 46.8%

AWS Rekognition

Age 20-38
Gender Male, 53.3%
Confused 45.2%
Happy 45%
Surprised 45%
Calm 45.4%
Angry 45.2%
Sad 54.1%
Disgusted 45%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Chair 80.4%
Painting 63.7%

Categories

Imagga

people portraits 89.9%
interior objects 3%
events parties 2.7%
paintings art 1.9%
pets animals 1.6%

Captions

Microsoft
created on 2019-06-06

a vintage photo of a cat 74.4%
a vintage photo of a person 74.3%
a vintage photo of some people 74.2%

Text analysis

Amazon

Making.
Bosket Making.
Bosket

Google

HI/ Bosket Making.
HI/
Bosket
Making.