Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: A Family at Dinner

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2859.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: A Family at Dinner

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Chair 99.9
Furniture 99.9
Restaurant 99.8
Person 98.8
Human 98.8
Person 98.3
Chair 97.7
Tablecloth 97.5
Person 96.3
Person 94.8
Person 93.9
Person 93.7
Table 93.6
Dining Table 93.6
Home Decor 92.6
Food Court 92.6
Food 92.6
Linen 92.4
Person 90.6
Person 89.1
Person 87.2
Cafeteria 85.9
Chair 84.4
Indoors 84
Room 84
Chair 81.2
Person 80.7
Person 72.7
Meal 65.7
Person 64.3
Dining Room 64.1
Reception 61.3
Reception Room 60.7
Waiting Room 60.7

Clarifai
created on 2019-06-05

people 100
many 99.9
group together 99.6
group 99.5
adult 98.9
furniture 98.7
administration 98.4
leader 98.1
man 97.2
several 96.9
woman 96.8
chair 96.6
education 94.5
room 94.4
military 94.1
sit 93.5
dining room 92.3
meeting 88.9
war 86.7
employee 84.9

Imagga
created on 2019-06-05

room 100
classroom 95.8
interior 60.2
restaurant 58.3
chair 50.9
table 48.6
furniture 41.3
modern 30.2
house 29.3
design 28.7
building 27.7
cafeteria 27
dining 26.7
wood 25.9
barbershop 25.9
empty 25.8
home 25.6
floor 25.1
decor 24.8
indoor 23.8
indoors 22
shop 21.5
style 20.8
chairs 20.6
kitchen 20.3
structure 19.3
contemporary 18.8
seat 18.5
inside 18.4
luxury 18
glass 17.9
food 17.6
window 17.4
comfortable 17.2
architecture 17.2
dinner 17
tables 16.8
light 16.7
decoration 15.9
bar 15.7
mercantile establishment 15.5
office 15.4
drink 15.1
stool 14.8
hotel 14.3
eat 14.3
lunch 13.6
residential 13.4
stove 12.8
elegance 12.6
nobody 12.5
lamp 12.4
counter 12.1
service 12.1
hall 11.9
wooden 11.4
drawer 10.9
oven 10.8
decorate 10.5
place of business 10.3
wall 10.3
space 10.1
refrigerator 9.9
business 9.7
plant 9.7
lighting 9.7
sofa 9.6
tile 9.5
party 9.5
desk 9.5
work 9.4
man 9.4
lifestyle 9.4
place 9.3
relax 9.3
cook 9.2
meal 9.1
people 8.9
cabinets 8.9
upscale 8.9
walls 8.8
elegant 8.6
living 8.5
relaxation 8.4
coffee 8.4
teacher 8.1
computer 8
urban 7.9
sink 7.9
conference 7.8
residence 7.8
class 7.7
person 7.6
meeting 7.5
occupation 7.3
group 7.3
success 7.3
stylish 7.2
steel 7.1

Google
created on 2019-06-05

Restaurant 93.6
Room 86.8
Classroom 63.1
Event 62.7
Cafeteria 59.2
Table 58.6
Building 58.4
Class 57.6
Business 54.2

Microsoft
created on 2019-06-05

indoor 99.9
ceiling 99.8
wall 99.8
table 99.3
furniture 93.9
person 93.8
chair 89.2
clothing 86.9
room 82
library 75.2
man 65.3
classroom 63.3
restaurant 31.5
dining room 17.8
dining table 7

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Male, 54.7%
Surprised 45%
Happy 45%
Confused 45.1%
Sad 54.2%
Calm 45.3%
Disgusted 45.1%
Angry 45.2%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%
Sad 47.4%
Calm 45.1%
Happy 50%
Angry 47.2%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 45.7%
Sad 51.1%
Disgusted 45.4%
Happy 46.3%
Surprised 45.4%
Angry 45.8%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Disgusted 45%
Confused 45%
Angry 45%
Sad 45.1%
Surprised 45%
Happy 45.1%
Calm 54.7%

AWS Rekognition

Age 17-27
Gender Female, 52.3%
Disgusted 45.9%
Happy 45.4%
Surprised 45.5%
Angry 46.8%
Confused 45.3%
Calm 49.8%
Sad 46.3%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Confused 49.5%
Happy 49.6%
Angry 49.6%
Sad 49.8%
Calm 49.8%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Calm 49.7%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Sad 50.2%
Happy 49.6%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Sad 50%
Surprised 49.5%
Happy 49.5%
Disgusted 49.6%
Angry 49.7%
Calm 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50%
Disgusted 49.5%
Calm 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.6%
Sad 50.3%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Sad 49.8%
Surprised 49.5%
Disgusted 49.7%
Calm 49.7%
Happy 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Angry 49.6%
Disgusted 49.6%
Confused 49.5%
Calm 49.7%
Happy 49.6%
Surprised 49.5%
Sad 50%

Feature analysis

Amazon

Chair 99.9%
Person 98.8%

Captions

Microsoft

a group of people in a room 98.1%
a group of people sitting at a table in a room 95.2%
a group of people standing in a room 95.1%