Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Record Room, Central Building, File Cases.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.143.1

Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Record Room, Central Building, File Cases.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.143.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.3
Human 99.3
Person 99.2
Shop 89.7
Restaurant 89.4
Interior Design 87.2
Indoors 87.2
Person 79.9
Person 79.7
Cafe 79.6
Painting 78.6
Art 78.6
Bakery 78
Furniture 72.8
Meal 71
Food 71
Cafeteria 63.9
Reception 59
Room 56.6
Jewelry Store 56.3

Clarifai
created on 2019-06-05

people 100
furniture 99.4
administration 98.6
adult 98.2
one 97.9
leader 97.7
man 97.5
room 96.8
print 96.4
home 96.2
two 95.9
indoors 95
group 94.5
seat 93.9
chair 93.5
many 92.5
four 89.8
military 89.3
no person 89.3
sit 88.4

Imagga
created on 2019-06-05

interior 37.2
architecture 34.6
house 34.2
room 31.4
counter 30.2
home 26.3
structure 25.7
altar 24.1
building 24.1
furniture 22.8
barbershop 22.1
shop 22
luxury 21.4
window 21.2
decor 20.3
table 18.8
old 18.1
chair 18.1
inside 17.5
ancient 17.3
sculpture 16.9
design 16.9
lamp 16.2
history 16.1
wood 15.8
stone 15.4
marble 15.3
tourism 14.9
travel 14.8
decoration 14.5
landmark 14.4
wall 14.4
elegant 13.7
indoor 13.7
mercantile establishment 13.7
fountain 13.6
modern 13.3
traditional 13.3
historical 13.2
kitchen 13
floor 13
statue 12.7
light 12.7
city 12.5
glass 12.5
residential 12.4
antique 11.9
column 11.4
town 11.1
style 11.1
church 11.1
elegance 10.9
arch 10.7
hall 10.6
tile 10.6
art 10.5
fireplace 10.4
sink 10.3
culture 10.3
famous 10.2
historic 10.1
water 10
cabinet 10
indoors 9.7
flowers 9.6
comfortable 9.6
estate 9.5
living 9.5
place of business 9.3
street 9.2
religion 9
apartment 8.6
expensive 8.6
real 8.5
monument 8.4
tourist 8.2
new 8.1
balcony 8.1
bathroom 8
facade 7.8
baroque 7.8
luxurious 7.8
lighting 7.7
construction 7.7
flower 7.7
god 7.7
hotel 7.6
vintage 7.4
dwelling 7.3
residence 7.1
day 7.1

Google
created on 2019-06-05

Photograph 96.6
Room 86.7
Snapshot 85.8
Furniture 74.7
Antique 68.5
Stock photography 67.6
Classic 63.8
Collection 62.9
Interior design 62.5
Photography 62.4
Art 58.1
Vintage clothing 55.9
History 54.1
House 53.7

Microsoft
created on 2019-06-05

wall 98.8
furniture 96
indoor 95
table 94.9
house 86.8
old 78.7
person 77.5
white 67.1
interior 66.3
clothing 63.4
cabinetry 51
vase 51
vintage 28.3
fireplace 21.8
altar 13.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Sad 54.9%
Angry 45%
Happy 45%
Surprised 45%
Confused 45%
Calm 45%
Disgusted 45%

AWS Rekognition

Age 15-25
Gender Female, 54.3%
Confused 46%
Surprised 45.9%
Sad 49.8%
Calm 46.9%
Happy 45.4%
Angry 45.6%
Disgusted 45.4%

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Happy 45.8%
Disgusted 47%
Calm 46.4%
Sad 48.3%
Confused 45.9%
Surprised 45.8%
Angry 45.9%

Feature analysis

Amazon

Person 99.3%
Painting 78.6%

Categories

Imagga

streetview architecture 88.9%
interior objects 10.4%

Captions

Microsoft
created on 2019-06-05

a vintage photo of a fireplace 77.7%
a vintage photo of a living room 67.4%
a vintage photo of a person 66.8%

Text analysis

Amazon

CASE.
FILE.
Rocm,
BU!LDING.
RECORd Rocm, CEnTeaL BU!LDING. FILE. CASE.
RECORd
CEnTeaL

Google

FILE CASES. PECORD RocM, CENTRAL BU:1.DING,
FILE
CASES.
PECORD
RocM,
CENTRAL
BU:1.DING,