Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Mechanical Drawing.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3226.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Mechanical Drawing.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Flooring 99.4
Human 99.4
Furniture 97.8
Chair 97.8
Person 97.7
Person 97.4
Wood 96.1
Hardwood 96
Floor 90.3
Restaurant 88.1
Room 87
Indoors 87
Cafeteria 82.1
Cafe 67.7
Interior Design 67.3
Person 63.5
Chair 62.6
Person 60

Clarifai
created on 2019-06-07

furniture 99.6
room 99.4
people 99.1
table 97.9
chair 96.8
seat 94.5
indoors 93.7
desk 92.4
adult 90.8
home 90.4
group together 89.4
many 86.9
administration 83.6
group 83.4
dining room 82.7
family 82.7
wood 78.9
man 78
interior design 75.3
house 73.7

Imagga
created on 2019-06-07

room 88.2
interior 74.3
furniture 55.3
chair 52.9
table 51.6
patio 50.1
house 49.3
home 48.7
area 40.8
floor 40
classroom 37.7
design 36.6
structure 35.9
modern 35.1
wood 34.2
decor 33.6
restaurant 29.5
luxury 27.5
indoor 26.5
kitchen 26.2
architecture 23.4
inside 23
dining 22.8
chairs 22.5
window 22.1
residential 22
living 21.8
counter 20.8
decoration 20.3
sofa 20.2
style 20
seat 19.5
glass 19.5
lamp 19.1
contemporary 18.8
building 18.7
empty 18
indoors 17.6
light 16.7
wall 16.1
residence 15.6
decorate 15.2
stove 14.8
apartment 14.4
hotel 14.3
hall 14.3
dinner 14.3
food 14
tables 13.8
estate 13.3
oven 12.8
couch 12.6
tile 12.5
expensive 12.5
comfortable 12.4
wooden 12.3
upscale 11.9
domestic 11.8
space 11.6
real 11.4
office 11.4
plant 11.3
place 11.2
stool 11
cabinet 10.9
elegance 10.9
eat 10.9
drawer 10.9
refrigerator 10.9
rug 10.9
3d 10.8
hardwood 10.8
sink 10.8
carpet 10.7
lighting 10.6
cafeteria 10.2
bar 10.2
relax 10.1
cook 10.1
cabinets 9.9
living room 9.8
new 9.7
fireplace 9.5
render 9.5
nobody 9.3
relaxation 9.2
marble 9
cozy 8.9
lunch 8.6
elegant 8.6
drink 8.4
clean 8.4
stylish 8.1
work 8
granite 7.8
lounge 7.8
fashion 7.5
service 7.4
warm 7.4
island 7.3
steel 7.1
desk 7.1

Google
created on 2019-06-07

Photograph 95.3
Snapshot 85.5
Room 84.3
Table 71.7
Flooring 65.4
Furniture 64.7
Photography 62.4
Building 61.5
Interior design 59.1
Black-and-white 56.4
Floor 53.9
Cafeteria 52.3

Microsoft
created on 2019-06-07

table 98.5
indoor 97.2
floor 91.7
person 82.1
room 79.2
living 77.6
chair 75.1
kitchen & dining room table 58.2
furniture 22.2
several 14

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 51%
Sad 46.4%
Confused 45.8%
Disgusted 46.7%
Angry 46.2%
Happy 46.8%
Surprised 45.6%
Calm 47.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Angry 49.7%
Confused 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.6%
Sad 50.1%
Happy 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Disgusted 49.7%
Confused 49.6%
Happy 49.7%
Calm 49.6%
Surprised 49.6%
Angry 49.6%
Sad 49.8%

AWS Rekognition

Age 23-38
Gender Female, 54%
Confused 45.4%
Sad 50.4%
Disgusted 45.8%
Calm 45.1%
Happy 46.6%
Surprised 45.5%
Angry 46.2%

AWS Rekognition

Age 35-52
Gender Male, 50%
Confused 49.5%
Surprised 49.6%
Happy 49.7%
Sad 49.7%
Disgusted 49.7%
Angry 49.7%
Calm 49.6%

Feature analysis

Amazon

Chair 97.8%
Person 97.7%

Captions

Microsoft

a group of people in a room 92.1%
a group of people standing in a room 87.4%
a group of people in a living room 71.8%

Text analysis

Amazon

Mechonicol
Mechonicol Drewwingg.
Drewwingg.

Google

Mechonical Drowing
Mechonical
Drowing