Human Generated Data

Title

Charity, Aged: United States. New York. Buffalo. St. Francis Asylum: St. Francis Asylum, Buffalo, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.580.2

Human Generated Data

Title

Charity, Aged: United States. New York. Buffalo. St. Francis Asylum: St. Francis Asylum, Buffalo, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Machine 96.4
Indoors 95.1
Interior Design 95.1
Furniture 90.4
Bed 90.4
Human 84.2
Person 84.2
Room 66

Clarifai
created on 2019-06-07

people 99.9
furniture 99.9
room 99.5
adult 98.3
seat 98.1
group 97.6
chair 97.3
home 97.2
one 97.2
no person 96.7
two 96.5
indoors 96.4
wear 93.6
print 92.9
bed 92.5
art 91.1
watercraft 87.3
man 86.9
interior design 85.9
many 85.7

Imagga
created on 2019-06-07

wall clock 100
clock 92.6
timepiece 65.4
measuring instrument 42.3
old 23
instrument 22.9
wall 18.3
vintage 18.2
architecture 18.1
grunge 17.9
ancient 17.3
antique 16.4
room 16.2
paper 15.7
city 15
building 14.5
travel 14.1
town 13.9
texture 13.9
interior 13.3
aged 12.7
house 12.6
home 12
structure 11.9
design 11.8
tourism 11.5
stain 11.5
wallpaper 11.5
retro 11.5
culture 11.1
dirty 10.8
table 10.1
tower 9.8
history 9.8
urban 9.6
old fashioned 9.5
modern 9.1
landmark 9
grime 8.8
obsolete 8.6
business 8.5
stone 8.4
famous 8.4
grain 8.3
street 8.3
time 8.2
coast 8.1
light 8
artistic 7.8
crumpled 7.8
decoration 7.8
rustic 7.7
sky 7.6
worn 7.6
device 7.5
scenery 7.2
furniture 7.1
lamp 7

Google
created on 2019-06-07

Room 90.8
Snapshot 82.5
Interior design 82.1
Furniture 81.7
Stock photography 65.4
House 63.1
Photography 62.4
Vintage clothing 61.7
Table 58.6
Art 58.1
Visual arts 55
Chair 52.8

Microsoft
created on 2019-06-07

wall 99.7
indoor 99.3
black 73.9
old 70.8
decorated 41.4
furniture 25.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 55%
Angry 48.4%
Calm 47.5%
Sad 47.4%
Confused 46%
Disgusted 45.1%
Surprised 45.3%
Happy 45.3%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Bed 90.4%
Person 84.2%

Captions

Microsoft

a vintage photo of a living room 61.8%
a vintage photo of a room 61.7%
an old photo of a living room 61.6%