Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The children and staff eat in the same dining-room at family tables.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.158.2

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: The children and staff eat in the same dining-room at family tables.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Room 98.5
Indoors 98.5
Person 97.1
Human 97.1
Classroom 96.6
School 96.6
Person 95.5
Interior Design 94.9
Person 94.5
Chair 94.4
Furniture 94.4
Restaurant 94
Dining Room 91.3
Person 90.9
Person 84.9
Dining Table 84.6
Table 84.6
Painting 83.1
Art 83.1
Food 82.9
Meal 82.9
Person 82.2
Person 80.4
Person 77.6
Food Court 73.9
Cafeteria 68.5
Person 60.4
Couch 58.9
Dish 56
Cafe 55.5
Person 52.8
Person 46.9

Clarifai
created on 2019-06-05

people 100
group 99.4
many 99.3
furniture 99.3
room 98.7
adult 98.2
group together 97.8
dining room 96
man 95.5
chair 95.4
woman 94.9
leader 91.4
seat 90.8
administration 90.6
home 90.4
several 89.9
military 89.2
indoors 89.1
child 88.9
sit 88.8

Imagga
created on 2019-06-05

interior 61
room 56.1
table 44.9
furniture 44.4
house 42.6
chair 39.3
home 36.7
decor 33.6
window 30.8
modern 29.4
wood 28.3
floor 27.9
restaurant 26.7
architecture 26.6
design 26.4
luxury 25.7
dining 25.7
indoor 23.7
inside 21.2
living 20.8
indoors 19.3
lamp 18.4
hall 17.9
style 17.8
chairs 17.6
kitchen 17.5
sofa 17.3
residential 17.2
counter 17
contemporary 16.9
dinner 16.8
decoration 16.6
salon 16.4
glass 16.3
elegant 16.3
comfortable 16.2
classroom 15.8
residence 15.6
tables 14.8
carpet 14.6
building 14.3
decorate 14.3
shop 14
light 14
apartment 13.4
estate 13.3
seat 13
lifestyle 13
upscale 12.8
couch 12.6
wooden 12.3
dining room 11.9
relax 11.8
cafeteria 11.7
food 11.5
barroom 11.3
plant 11.2
classic 11.1
elegance 10.9
rug 10.8
hardwood 10.8
lighting 10.6
hotel 10.5
real 10.4
wall 10.4
empty 10.3
women 10.3
cabinet 10.2
bar 10.2
3d 10.1
life 9.9
stool 9.9
expensive 9.6
nobody 9.3
chandelier 9
spacious 8.9
furnishings 8.9
stove 8.9
fireplace 8.8
dwelling 8.8
vase 8.7
tile 8.7
render 8.7
space 8.5
flower 8.5
structure 8.4
service 8.3
mercantile establishment 8.3
warm 8.3
domestic 8.2
stylish 8.1
new 8.1
family 8
barbershop 8
day 7.8
people 7.8
bed 7.6
relaxation 7.5
bedroom 7.5
office 7.4
coffee 7.4
place of business 7

Google
created on 2019-06-05

Room 86.7
Snapshot 84.7
Dining room 74.9
Table 71.7
Photography 62.4
Family 58.3
Black-and-white 56.4
Restaurant 54.9
Interior design 54.3
History 54.1
House 53.7
Square 52.6
Building 50.8
Art 50.2

Microsoft
created on 2019-06-05

table 97.2
wall 96.4
furniture 96.3
person 93.9
chair 91.8
clothing 91.2
standing 79.1
gallery 69.6
room 65.8
people 63.9
posing 63.1
group 57.7
library 56.6
house 53.6
kitchen & dining room table 50.8

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Female, 53.2%
Disgusted 45.1%
Confused 45.2%
Calm 45.3%
Angry 46.1%
Happy 46.8%
Sad 51.3%
Surprised 45.2%

AWS Rekognition

Age 19-36
Gender Female, 54.9%
Angry 45.5%
Sad 47.8%
Surprised 45.8%
Happy 47.2%
Calm 47.3%
Disgusted 45.8%
Confused 45.5%

AWS Rekognition

Age 15-25
Gender Female, 54.9%
Sad 46.9%
Angry 45.9%
Confused 45.6%
Happy 47.5%
Disgusted 47.4%
Surprised 45.5%
Calm 46.1%

AWS Rekognition

Age 16-27
Gender Female, 53.5%
Surprised 45.9%
Disgusted 46%
Sad 46.8%
Calm 48.6%
Happy 46.7%
Confused 45.3%
Angry 45.6%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Sad 49.6%
Angry 49.6%
Calm 49.9%
Confused 49.5%
Happy 49.5%
Disgusted 49.8%
Surprised 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.2%
Disgusted 49.5%
Calm 49.6%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Sad 50.3%
Angry 49.5%
Calm 49.6%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Surprised 49.5%
Calm 50.2%
Happy 49.5%
Angry 49.5%
Sad 49.6%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Calm 49.8%
Surprised 49.6%
Confused 49.5%
Sad 49.7%
Angry 49.6%
Disgusted 49.7%
Happy 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.2%
Calm 49.7%
Disgusted 49.6%
Sad 49.8%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Angry 49.8%

AWS Rekognition

Age 12-22
Gender Female, 50.5%
Calm 49.7%
Sad 50%
Angry 49.6%
Confused 49.6%
Happy 49.6%
Disgusted 49.6%
Surprised 49.6%

Feature analysis

Amazon

Person 97.1%
Chair 94.4%
Painting 83.1%

Captions

Microsoft

a group of people posing for a photo 86.1%
a group of people standing in a room 86%
a group of people standing in a room posing for a photo 85.9%