Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Living rooms in the boys' and girls' cottages.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.293

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Living rooms in the boys' and girls' cottages.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.293

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 98.5
Human 98.5
Person 97.1
Person 95.1
Person 94.3
Person 94
Person 94
Person 93.2
Person 92.9
Indoors 89.9
Interior Design 89.9
Person 86.6
Person 84.2
Person 83.6
Person 83.2
Person 81.9
Person 81.2
Person 79.8
Person 78.2
Person 77.4
Person 76.7
Crowd 72.3
Room 67.3
People 64
Text 63.4
Person 62.7
Cafeteria 58.2
Restaurant 58.2
Person 57.6
Advertisement 55.6
School 55.1
Classroom 55.1

Clarifai
created on 2019-06-07

people 98.9
group 96.3
adult 95.4
indoors 92.5
furniture 92.5
many 90.7
room 89.6
man 88.7
woman 87.6
print 86.4
illustration 85
wear 84.1
no person 83.3
lithograph 82.4
art 80.6
child 80.3
home 78.9
one 77.3
chair 76.1
retro 75.4

Imagga
created on 2019-06-07

drawing 28.4
sketch 27.9
house 20.9
wagon 18.6
design 18.6
architecture 18
building 17.8
interior 17.7
structure 17.3
representation 16.6
wheeled vehicle 15.6
grunge 15.3
home 15.1
vintage 14
paper 13.3
construction 12.8
history 12.5
office 12.5
container 11.9
modern 11.9
old 11.8
frame 11.6
business 11.5
retro 11.5
city 10.8
room 10.5
style 10.4
empty 10.3
black 10.2
flag 10
antique 9.9
window 9.8
decor 9.7
urban 9.6
wall 9.5
decoration 9.4
book jacket 9.2
texture 9
light 8.7
ancient 8.6
blank 8.6
plan 8.5
travel 8.4
book 8.4
dirty 8.1
art 8
space 7.8
elegant 7.7
money 7.6
finance 7.6
vehicle 7.4
inside 7.4
transport 7.3
aged 7.2
jacket 7.2
emblem 7.1
indoors 7

Google
created on 2019-06-07

Photograph 96.9
Text 89
Snapshot 87.9
Room 80.8
Photography 70.6
Adaptation 67
Collection 66.8
Photograph album 63.3
Photographic paper 58.2
Album 56.6
Family 54.3
History 54.1
Child 52
Art 50.2

Microsoft
created on 2019-06-07

furniture 74.5
picture frame 57.9
person 50.7
different 50.4
several 18.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Surprised 49.6%
Happy 49.6%
Calm 49.7%
Angry 49.7%
Disgusted 49.6%
Sad 49.8%
Confused 49.5%

AWS Rekognition

Age 45-63
Gender Female, 50.4%
Surprised 49.5%
Sad 50.1%
Disgusted 49.5%
Calm 49.7%
Happy 49.6%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50.5%
Surprised 49.5%
Sad 50%
Disgusted 49.7%
Calm 49.6%
Happy 49.6%
Angry 49.5%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Calm 49.6%
Confused 49.5%
Happy 49.5%
Angry 49.7%
Surprised 49.5%
Disgusted 49.5%
Sad 50.1%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 50%
Surprised 49.6%
Angry 49.5%
Disgusted 49.5%
Happy 49.6%
Confused 49.6%
Sad 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.6%
Sad 49.9%
Happy 49.5%
Surprised 49.6%
Disgusted 49.6%
Confused 49.6%
Calm 49.7%

Feature analysis

Amazon

Person
Person 98.5%
Person 97.1%
Person 95.1%
Person 94.3%
Person 94%
Person 94%
Person 93.2%
Person 92.9%
Person 86.6%
Person 84.2%
Person 83.6%
Person 83.2%
Person 81.9%
Person 81.2%
Person 79.8%
Person 78.2%
Person 77.4%
Person 76.7%
Person 62.7%
Person 57.6%

Categories

Imagga

interior objects 82.6%
text visuals 12.7%
paintings art 1.8%
food drinks 1.5%

Captions

Microsoft
created on 2019-06-07

a group of people in a room 51.8%
a display in a store 47.8%

Text analysis

Amazon

Hebrew
Sheltering
Orphan
York
New
Soeiety
Hebrew Sheltering Guar ian Soeiety Orphan Asylum
Guar
Pleasaintvil New York
ros
Asylum
sylm
Pleasaintvil
ian
shleriig
i/s
e
rooas
uadinn
99.
-rew
disn
Linis e birs'
Linis
birs'
99. 45:1/
ros w
,t
45:1/
be ,t
be
w

Google

ch
99
Asrew
dian
adn
Hebrew
Sheltering
Guarddian
Society
Orphan
Asylum
Pleasantvil
le,
New
Lving
in
the
boy
and
giria'
costages.
+girts
comages
G ch 99 73, / Asrew dian So ha adn Hebrew Sheltering Guarddian Society Orphan Asylum Pleasantvil le, New York Lving rooms in the boy and giria' costages. +girts comages
G
73,
/
So
ha
York
rooms