Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: In the School Room
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2916.1

Human Generated Data

Title

Crime, Children, Reform Schools: United States. Massachusetts. Westboro. Lyman School for Boys: Lyman School for Boys: In the School Room

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2916.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

School 100
Indoors 100
Classroom 100
Room 100
Human 99.5
Person 99.5
Person 96.9
Person 95.1
Person 94.9
Person 90
Person 89.7
Person 88.6
Person 88.4
Person 87.3
Person 81.6
Person 81.5
Person 72.8
Person 64.6

Clarifai
created on 2019-06-05

people 99.9
many 99.8
group 99.6
group together 99.1
administration 99.1
adult 99
education 98.1
leader 97.8
man 96.7
furniture 96.3
woman 94.1
war 93.1
desk 92.9
teacher 91.8
classroom 91.6
room 91.5
school 90.3
several 90.1
military 88.9
chair 86.9

Imagga
created on 2019-06-05

room 100
classroom 100
interior 52.2
table 48.5
chair 39.8
furniture 32.4
modern 30.2
restaurant 28.5
house 25.9
home 24.7
indoors 24.6
design 24.2
empty 22.4
decor 22.1
floor 21.4
indoor 21
wood 20
dining 20
meeting 18.9
office 18.7
business 17
inside 16.6
hall 16.5
chairs 15.7
conference 15.7
window 15.6
luxury 15.5
contemporary 15.1
style 14.9
glass 14.8
tables 14.8
seat 14.5
dinner 14.3
kitchen 14.3
work 14.1
sofa 13.4
light 13.4
food 13.3
architecture 13.3
people 12.8
group 12.1
service 12.1
stool 11.9
drink 11.7
decoration 11.6
lifestyle 11.6
comfortable 11.5
lamp 11.5
desk 11.4
education 11.3
presentation 11.2
sitting 11.2
nobody 10.9
businessman 10.6
residential 10.5
living 10.4
corporate 10.3
men 10.3
women 10.3
bar 10.2
man 10.1
communication 10.1
cafeteria 10
male 9.9
stove 9.9
couch 9.7
hotel 9.6
decorate 9.5
talking 9.5
elegant 9.4
teamwork 9.3
elegance 9.2
eat 9.2
businesswoman 9.1
suit 9
plant 9
team 9
success 8.9
counter 8.8
residence 8.8
lighting 8.7
smiling 8.7
person 8.6
party 8.6
building 8.4
place 8.4
professional 8.4
coffee 8.3
occupation 8.3
computer 8
center 8
lunch 7.9
drawer 7.9
together 7.9
oven 7.9
day 7.9
sink 7.9
apartment 7.7
relax 7.6
relaxation 7.5
executive 7.4
cook 7.3
meal 7.3
stylish 7.2
teacher 7.2
urban 7

Google
created on 2019-06-05

Classroom 92.9
Class 89.9
Room 87.2
State school 68.8
Event 62.7
Building 55.4
School 53
Student 51.9
Education 50.5

Microsoft
created on 2019-06-05

indoor 98.2
wall 97.4
person 93.8
table 81.8
classroom 79.3
school 76.3
old 73.5
furniture 71.1
clothing 70.3
library 63.7
group 58.5
building 55.3
computer 54.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 99.3%
Sad 0.8%
Disgusted 0.3%
Surprised 0.8%
Happy 0.2%
Confused 0.4%
Angry 0.5%
Calm 97%

AWS Rekognition

Age 11-18
Gender Male, 85.2%
Angry 6.4%
Happy 1.9%
Surprised 1.7%
Calm 46.7%
Confused 3.6%
Sad 38.4%
Disgusted 1.4%

AWS Rekognition

Age 16-27
Gender Female, 54.5%
Sad 54.7%
Surprised 45%
Confused 45%
Disgusted 45%
Happy 45%
Calm 45.1%
Angry 45%

AWS Rekognition

Age 16-27
Gender Female, 52.1%
Disgusted 45.1%
Angry 45.1%
Sad 54.7%
Surprised 45%
Happy 45%
Calm 45%
Confused 45%

AWS Rekognition

Age 17-27
Gender Female, 52%
Confused 46.5%
Happy 45.5%
Calm 45.9%
Sad 47.6%
Angry 48%
Surprised 45.9%
Disgusted 45.6%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Disgusted 45.6%
Sad 48.8%
Surprised 45.4%
Calm 46%
Happy 45.3%
Confused 45.5%
Angry 48.4%

AWS Rekognition

Age 19-36
Gender Female, 52%
Sad 52.2%
Disgusted 45.4%
Confused 45.3%
Surprised 45.2%
Calm 45.9%
Happy 45.2%
Angry 45.9%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Calm 49.9%
Disgusted 49.5%
Confused 49.6%
Angry 49.6%
Sad 49.8%
Happy 49.5%
Surprised 49.6%

AWS Rekognition

Age 11-18
Gender Female, 54.3%
Happy 45.2%
Angry 46.1%
Disgusted 45.4%
Confused 45.5%
Sad 50.6%
Calm 46.8%
Surprised 45.4%

AWS Rekognition

Age 17-27
Gender Female, 50.1%
Surprised 49.5%
Happy 49.5%
Sad 50.3%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 50.1%
Surprised 49.5%
Disgusted 49.5%
Confused 49.6%
Sad 49.6%
Happy 49.6%
Angry 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Disgusted 49.6%
Calm 49.5%
Surprised 49.5%
Sad 50%
Confused 49.5%
Angry 49.7%
Happy 49.6%

AWS Rekognition

Age 38-59
Gender Female, 50.2%
Confused 49.6%
Angry 49.6%
Disgusted 49.6%
Surprised 49.6%
Sad 49.7%
Happy 49.7%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.5%
Disgusted 50.1%
Sad 49.7%
Confused 49.5%
Happy 49.6%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50.4%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Surprised 49.6%
Confused 49.6%
Sad 49.9%
Calm 49.5%
Happy 49.5%
Disgusted 49.6%
Angry 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.6%
Calm 49.7%
Angry 49.6%
Sad 49.7%
Happy 49.8%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 30-47
Gender Male, 50.1%
Surprised 49.5%
Sad 50.2%
Happy 49.6%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 50.4%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Calm 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50.1%
Happy 49.5%
Disgusted 49.5%
Confused 49.6%
Surprised 49.5%
Sad 50.2%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Disgusted 49.5%
Confused 49.5%
Angry 49.6%
Sad 50.3%
Surprised 49.5%
Happy 49.5%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Sad 50.1%
Happy 49.5%
Disgusted 49.5%
Calm 49.7%
Angry 49.6%
Confused 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Calm 45.1%
Happy 45%
Angry 51.8%
Sad 47.4%
Surprised 45.1%
Confused 45.1%
Disgusted 45.5%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Angry 49.6%
Disgusted 49.7%
Sad 49.6%
Confused 49.5%
Happy 50%
Surprised 49.6%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.8%
Surprised 49.6%
Disgusted 49.5%
Happy 49.6%
Calm 49.6%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Calm 49.6%
Confused 49.6%
Angry 49.7%
Surprised 49.6%
Disgusted 49.6%
Sad 49.8%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Sad 50.2%
Confused 49.5%
Disgusted 49.5%
Calm 49.7%

AWS Rekognition

Age 15-25
Gender Male, 50.5%
Disgusted 50%
Calm 49.6%
Surprised 49.5%
Sad 49.7%
Confused 49.6%
Angry 49.6%
Happy 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Surprised 49.5%
Confused 49.5%
Happy 49.5%
Angry 49.6%
Calm 49.6%
Sad 50.2%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.5%
Angry 49.5%
Sad 49.5%
Surprised 49.6%
Happy 49.5%
Calm 50.3%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Male, 50.3%
Calm 50%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.6%
Angry 49.6%
Sad 49.6%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Categories

Imagga

people portraits 39.1%
interior objects 34.1%
events parties 25.7%