Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: At Play
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3232.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: At Play

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3232.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 99.3
Human 99.3
Person 99
Person 98.8
Chair 96.9
Furniture 96.9
Restaurant 96.6
Person 95.9
Person 93.8
Cafeteria 92.8
Person 89.2
Room 88.7
Indoors 88.7
Person 82.1
Cafe 80.1
Couch 76.6
Sitting 76.3
Flooring 72.8
Person 70.2
Floor 69.8
Person 68.5
Housing 67.7
Building 67.7
Person 65.8
Wood 64.3
Living Room 58.6
Waiting Room 58.4
School 57.9
Classroom 57.9
Table 57.2

Clarifai
created on 2019-06-07

people 99.8
group 97.7
furniture 97.6
group together 97.5
many 96.6
chair 95.1
room 94.9
adult 94.2
desk 92.9
indoors 92.7
man 91.4
administration 91.2
seat 89.2
woman 88.6
several 87.8
child 87.6
education 86
military 84.8
recreation 84
sit 81.9

Imagga
created on 2019-06-07

room 100
classroom 83.1
interior 67.3
chair 63.6
furniture 53.2
table 52
floor 36.3
home 32.7
modern 32.3
design 32.1
house 31.8
barbershop 30.6
decor 28.3
indoors 28.1
shop 27.9
restaurant 27
wood 25
seat 24.8
inside 24
architecture 22.7
sofa 22
window 22
lamp 21
light 20.7
empty 20.6
indoor 19.2
living 19
chairs 18.6
building 18.6
mercantile establishment 18.4
luxury 18
residential 17.2
dining 17.1
style 17.1
contemporary 16.9
decoration 16.7
office 16.4
glass 16.4
apartment 16.3
lighting 15.5
couch 14.5
comfortable 14.3
place of business 13.4
decorate 13.3
wall 12.8
food 12.7
carpet 12.7
relax 12.6
elegance 12.6
kitchen 12.6
hotel 12.4
business 12.2
tables 11.8
hardwood 11.8
living room 11.8
desk 11.7
structure 11.4
barber chair 11.2
place 11.2
bar 11.1
upscale 10.9
domestic 10.9
3d 10.9
cafeteria 10.4
work 10.2
dinner 10.1
nobody 10.1
residence 9.7
wooden 9.7
estate 9.5
leather 9.5
real 9.5
space 9.3
counter 9.1
hall 9
fireplace 9
salon 8.8
marble 8.7
render 8.7
elegant 8.6
occupation 8.3
computer 8
stool 8
establishment 7.9
refrigerator 7.9
furnishings 7.9
stove 7.9
urban 7.9
oven 7.9
conference 7.8
equipment 7.6
mirror 7.6
eat 7.6
drink 7.5
plant 7.5
lights 7.4
coffee 7.4
new 7.3
armchair 7.3
stylish 7.2
lifestyle 7.2

Google
created on 2019-06-07

Snapshot 86.4
Room 80.8
Photography 62.4
Building 50.8

Microsoft
created on 2019-06-07

indoor 99.2
floor 98.9
ceiling 98.7
table 98.3
wall 96.5
person 94.9
chair 91.8
clothing 87.2
desk 82.1
room 76.8
man 67.7
computer 54.9
house 51
furniture 21.8
several 13.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Sad 48%
Happy 45.6%
Angry 46%
Surprised 45.7%
Disgusted 46.5%
Confused 45.9%
Calm 47.2%

AWS Rekognition

Age 38-57
Gender Male, 54.8%
Sad 46.5%
Confused 45.2%
Disgusted 45.2%
Calm 51.7%
Happy 45.7%
Angry 45.3%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Confused 49.5%
Sad 49.7%
Disgusted 49.6%
Calm 49.5%
Happy 49.5%
Surprised 49.5%
Angry 50.2%

AWS Rekognition

Age 17-27
Gender Female, 50.5%
Calm 49.5%
Happy 49.6%
Surprised 49.5%
Disgusted 49.6%
Sad 50%
Angry 49.5%
Confused 49.7%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Calm 49.5%
Happy 49.6%
Disgusted 49.8%
Surprised 49.5%
Angry 49.7%
Sad 49.8%
Confused 49.5%

AWS Rekognition

Age 12-22
Gender Female, 52.8%
Calm 45.2%
Disgusted 52.2%
Sad 46.3%
Happy 45.3%
Surprised 45.2%
Angry 45.7%
Confused 45.1%

AWS Rekognition

Age 4-9
Gender Female, 50.3%
Calm 49.6%
Surprised 49.5%
Angry 49.8%
Disgusted 49.6%
Happy 49.5%
Confused 49.6%
Sad 49.8%

AWS Rekognition

Age 38-59
Gender Male, 50.4%
Disgusted 49.8%
Angry 49.6%
Surprised 49.5%
Sad 49.6%
Calm 49.5%
Confused 49.5%
Happy 50%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Sad 50.1%
Confused 49.5%
Disgusted 49.6%
Calm 49.6%
Happy 49.5%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 38-59
Gender Female, 50.3%
Sad 49.8%
Calm 49.8%
Angry 49.6%
Disgusted 49.7%
Confused 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.1%
Angry 49.6%
Happy 49.6%
Confused 49.5%
Disgusted 49.6%
Sad 49.9%
Surprised 49.5%
Calm 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.6%
Happy 49.5%
Sad 50.3%

Feature analysis

Amazon

Person 99.3%
Chair 96.9%

Categories

Imagga

interior objects 91.3%
cars vehicles 5.9%
streetview architecture 1.3%

Text analysis

Amazon

At
At ploy.
ploy.

Google

HOHODHODK play. At
HOHODHODK
play.
At