Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: Just Before Dinner.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2859.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: Just Before Dinner.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2859.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Furniture 99.4
Chair 99.4
Person 99.1
Human 99.1
Person 98.6
Person 97.9
Person 97.9
Chair 97.8
Person 96.9
Person 96.8
Restaurant 95.5
Person 94.1
Footwear 94
Apparel 94
Clothing 94
Shoe 94
Cafeteria 88.6
Person 86
Person 80.4
Room 80.2
Indoors 80.2
Person 78.3
Person 74
Person 73.7
Person 69.6
Person 68
Person 66.2
School 59.3
Classroom 59.3
Person 56.2
Chair 52.7
Person 44.7

Clarifai
created on 2019-06-05

people 100
many 99.8
group 99.7
group together 99.7
adult 99.1
furniture 98.9
several 97.9
man 96.8
woman 96.5
military 95.2
watercraft 95
leader 94.5
chair 94.5
room 94
administration 91.9
vehicle 91.8
seat 91.7
wear 88.9
education 88.3
indoors 87.9

Imagga
created on 2019-06-05

room 72.8
classroom 51.8
interior 47.7
table 42.7
chair 41.3
restaurant 33.1
furniture 31.5
hall 24.7
modern 23.8
dining 23.8
house 20.9
decor 20.3
indoors 20.2
home 18.3
empty 18
floor 17.7
design 17.4
chairs 16.6
indoor 16.4
cafeteria 16.4
glass 16.3
salon 15.8
dinner 15.3
people 15.1
tables 14.8
barbershop 14.8
seat 14.7
window 14.6
teacher 14.6
comfortable 14.3
wood 14.2
shop 14.1
architecture 14.1
luxury 13.7
building 13.3
decoration 13
contemporary 12.2
person 12.2
office 12.2
food 12.1
man 12.1
men 12
elegant 12
style 11.9
life 11.5
urban 11.4
women 11.1
work 11
business 10.9
male 10.6
hospital 10.5
banquet 10.4
place 10.2
service 10.2
inside 10.1
lifestyle 10.1
elegance 10.1
relaxation 10
kitchen 10
city 10
meal 9.9
professional 9.8
lamp 9.5
day 9.4
light 9.4
adult 9.3
drink 9.2
structure 9.1
mercantile establishment 9
stool 8.9
educator 8.8
sofa 8.6
party 8.6
hotel 8.6
sitting 8.6
nobody 8.5
relax 8.4
eat 8.4
bar 8.3
lunch 8
businessman 7.9
wooden 7.9
scene 7.8
3d 7.7
living 7.6
wine 7.4
group 7.2
smiling 7.2

Google
created on 2019-06-05

Room 85.4
Table 58.6
Black-and-white 56.4
Monochrome 54.4

Microsoft
created on 2019-06-05

floor 99.3
indoor 98.9
chair 96.1
person 95.4
furniture 95.2
table 90.4
clothing 86.3
ceiling 83.9
group 66
old 44.5
dressed 25.4
several 22.7
clothes 19.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Disgusted 48%
Confused 45.2%
Angry 46.7%
Sad 48.7%
Surprised 45.2%
Happy 45.8%
Calm 45.4%

AWS Rekognition

Age 20-38
Gender Female, 50.8%
Disgusted 45.3%
Confused 45.3%
Angry 45.5%
Calm 46%
Surprised 45.5%
Happy 45.5%
Sad 52%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Sad 48.9%
Angry 45.6%
Calm 47.4%
Happy 46.9%
Disgusted 45.3%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 11-18
Gender Female, 54.5%
Sad 45.6%
Happy 45.2%
Disgusted 46.8%
Calm 45.2%
Angry 51.1%
Confused 45.5%
Surprised 45.5%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.6%
Sad 50.1%
Confused 49.5%
Angry 49.6%
Surprised 49.6%
Calm 49.5%

AWS Rekognition

Age 17-27
Gender Male, 50.5%
Sad 49.7%
Angry 49.6%
Calm 50%
Confused 49.5%
Happy 49.6%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Calm 49.6%
Confused 49.5%
Sad 50.2%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.6%
Happy 49.8%
Confused 49.5%
Sad 49.8%
Calm 49.6%
Disgusted 49.7%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Surprised 45.2%
Angry 45.4%
Disgusted 45.2%
Sad 51.9%
Happy 45.2%
Confused 45.2%
Calm 46.8%

AWS Rekognition

Age 20-38
Gender Female, 50%
Surprised 49.5%
Calm 49.7%
Happy 49.6%
Sad 49.9%
Confused 49.6%
Angry 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.6%
Disgusted 49.9%
Calm 49.7%
Confused 49.5%
Angry 49.6%
Surprised 49.6%
Happy 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Happy 49.6%
Disgusted 49.6%
Confused 49.6%
Surprised 49.6%
Sad 49.9%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Sad 49.8%
Calm 49.8%
Disgusted 49.5%
Happy 49.7%
Confused 49.5%
Angry 49.5%
Surprised 49.6%

AWS Rekognition

Age 4-7
Gender Female, 51.3%
Disgusted 46.6%
Calm 45.4%
Confused 45.3%
Surprised 45.3%
Happy 45.4%
Angry 45.5%
Sad 51.6%

Feature analysis

Amazon

Chair 99.4%
Person 99.1%
Shoe 94%