Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass. The Reading Room.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.412.1

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass. The Reading Room.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.412.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 98.8
Human 98.8
Person 95.4
Furniture 93.6
Person 83.6
Interior Design 80.6
Indoors 80.6
Room 79.7
Person 77.9
Shelf 75.8
Bookcase 65.7
Text 63.8
Living Room 61.5
Book 60.3
Reading 57.6

Clarifai
created on 2019-06-05

people 99.8
education 99.3
adult 99.1
group 99
school 97.3
administration 96.6
desk 96.2
man 96
furniture 95.9
several 95
sit 95
room 94.9
group together 94.5
concentration 93.9
child 93.4
book series 92.9
teacher 92.7
two 91.6
woman 91.4
many 90.4

Imagga
created on 2019-06-05

classroom 81.4
room 61.7
man 42.4
office 41.7
male 36.9
people 36.3
group 29.8
meeting 28.3
person 28.2
table 27.2
education 26.9
laptop 26.7
business 26.1
teacher 24.6
adult 24.5
businessman 23.8
happy 23.8
team 23.3
men 22.3
school 22.2
student 22
computer 21.7
sitting 21.5
desk 20.3
couple 19.2
women 19
smiling 18.8
teamwork 18.6
together 18.4
businesswoman 18.2
work 18.1
home 17.6
professional 17.5
indoors 16.7
smile 16.4
class 16.4
senior 15.9
corporate 15.5
blackboard 15
looking 14.4
communication 14.3
talking 14.3
college 14.2
job 14.2
working 14.1
friends 14.1
modern 14
newspaper 13.9
menu 13.9
cheerful 13.8
indoor 13.7
discussion 13.6
restaurant 13.3
study 13.1
portrait 12.9
color 12.8
executive 12.5
building 12.3
lifestyle 12.3
mature 12.1
technology 11.9
university 11.8
conference 11.7
students 11.7
colleagues 11.7
fare 11.5
studying 11.5
workplace 11.4
businesspeople 11.4
manager 11.2
occupation 11
happiness 11
teaching 10.7
to 10.6
center 10.5
notebook 10.4
learning 10.3
casual 10.2
two 10.2
successful 10.1
product 9.9
success 9.7
reading 9.5
adults 9.5
board 9
suit 9
handsome 8.9
books 8.7
boy 8.7
show 8.5
females 8.5
educator 8.5
writing 8.5
friendship 8.4
horizontal 8.4
coffee 8.3
human 8.3
20s 8.2
book 8.2
interior 8
coworkers 7.9
mathematics 7.8
structure 7.8
face 7.8
two people 7.8
busy 7.7
knowledge 7.7
food 7.7
creation 7.7
house 7.5
screen 7.5
presentation 7.4
new 7.3
black 7.2
worker 7.1
day 7.1
director 7

Google
created on 2019-06-05

Photograph 96.2
Snapshot 87.4
Text 85.2
Room 74.4
Adaptation 67
Photography 62.4
History 54.1
Furniture 53.3
Writing 52.6

Microsoft
created on 2019-06-05

library 93.7
book 93.5
indoor 86.2
reading 66.9
person 58.6
black and white 52.9
computer 50.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 51.7%
Sad 45.8%
Angry 45.2%
Confused 45.1%
Happy 45.1%
Disgusted 45%
Surprised 45.3%
Calm 53.5%

AWS Rekognition

Age 35-52
Gender Male, 58.7%
Angry 3.9%
Sad 93.2%
Disgusted 2%
Calm 0.3%
Surprised 0.2%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 35-52
Gender Male, 79%
Calm 4%
Disgusted 4.1%
Angry 48.2%
Happy 0.2%
Sad 39.4%
Surprised 1.7%
Confused 2.4%

AWS Rekognition

Age 26-43
Gender Male, 50.6%
Happy 45%
Sad 53.9%
Confused 45.2%
Calm 45.2%
Angry 45.4%
Disgusted 45%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Male, 52.5%
Angry 50.4%
Happy 45.2%
Disgusted 47.1%
Confused 45.3%
Calm 45.8%
Surprised 45.2%
Sad 46.1%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Book 60.3%

Categories

Imagga

interior objects 98.3%

Text analysis

Amazon

Reding
The
The Reding Roorn.
Roorn.

Google

RKnaekebe The Readrng Room
RKnaekebe
The
Readrng
Room