Human Generated Data

Title

Interior View of Memorial Hall, Harvard College
Date

19th century
People

Artist: Shaw & Lord,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2019.167

Human Generated Data

Title

Interior View of Memorial Hall, Harvard College

People

Artist: Shaw & Lord,

Date

19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2019.167

Machine Generated Data

Tags

Amazon
created on 2022-08-03

Person 99.2
Human 99.2
Person 98.9
Building 98.4
Architecture 98.1
Indoors 97.5
Person 97.3
Person 96.6
Person 95.8
Person 93.1
Aisle 91.8
Painting 90.9
Art 90.9
Lighting 90.9
Person 89.4
Church 89.4
Person 89.2
Person 88.5
Person 86.6
Person 86.5
Altar 84
Apse 83.2
Person 82.9
Person 81.7
Person 80.9
Person 80.2
Person 77.5
Person 76.4
Person 76
Person 75.8
Person 75.6
Person 74.6
Interior Design 72
Person 69.6
Person 67.7
Person 67.4
Person 65.4
Cathedral 63.3
Person 63.3
Person 62.9
Housing 62.1
Monastery 58.7
Robe 56
Clothing 56
Fashion 56
Apparel 56
Person 53.8

Clarifai
created on 2023-10-12

people 99.9
many 99.5
group 99.2
street 98.8
art 95.8
crowd 95.3
man 93.8
group together 93.1
child 90.6
adult 88.7
woman 83.4
building 83.4
print 82
church 80.7
cavalry 79.4
city 78.4
vehicle 77.5
architecture 77.3
painting 75.2
light 73.8

Imagga
created on 2022-08-03

hall 42.2
stage 32.7
night 27.5
city 24.1
theater curtain 23.4
building 23.3
architecture 23.1
platform 22.5
structure 18.9
curtain 18.6
old 16.7
light 16.7
travel 16.2
urban 15.7
blind 14
street 12.9
dark 12.5
house 12
room 11.8
cinema 11.6
train 11.5
wall 11.4
lights 11.1
winter 11.1
park 11
center 10.8
tree 10.8
transportation 10.8
people 10.6
balcony 10.4
cold 10.3
station 10.3
protective covering 9.7
lamp 9.7
theater 9.6
entertainment 9.2
snow 9.2
tourism 9.1
interior 8.8
scene 8.6
crowd 8.6
holiday 8.6
black 8.4
outdoor 8.4
historic 8.2
landmark 8.1
history 8
classroom 7.9
arch 7.7
construction 7.7
track 7.7
capital 7.6
stone 7.6
destination 7.5
place 7.4
vintage 7.4
business 7.3
dirty 7.2
road 7.2
world 7.1

Google
created on 2022-08-03

Art 81.8
Event 74.3
Painting 73.3
Visual arts 67.6
Holy places 67.4
History 66.6
Illustration 64.8
Rectangle 64.1
Paper product 63.6
Stock photography 62.9
Room 62
Collection 60
Arch 56.2
Font 56.1
Tourist attraction 51.6
Crowd 50.1

Microsoft
created on 2022-08-03

text 100
person 50.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 7-17
Gender Male, 83.7%
Calm 77%
Sad 9.3%
Confused 8.8%
Surprised 7.4%
Fear 5.9%
Happy 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Female, 74%
Calm 79.5%
Happy 8.8%
Surprised 6.8%
Fear 6.1%
Sad 4.3%
Angry 2.7%
Confused 1.3%
Disgusted 0.9%

AWS Rekognition

Age 21-29
Gender Male, 93%
Calm 66.8%
Disgusted 8.8%
Fear 7.4%
Surprised 7.3%
Angry 6.8%
Happy 6.4%
Sad 4.1%
Confused 1%

AWS Rekognition

Age 21-29
Gender Female, 51%
Calm 82.4%
Sad 15.8%
Surprised 6.3%
Fear 5.9%
Happy 1.2%
Disgusted 0.6%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 97.5%
Calm 76.6%
Happy 13.9%
Surprised 7.5%
Fear 6.2%
Sad 3%
Angry 2.2%
Confused 1%
Disgusted 0.9%

AWS Rekognition

Age 20-28
Gender Male, 97.9%
Sad 69.1%
Calm 36.5%
Happy 18.4%
Surprised 7%
Fear 6.7%
Disgusted 4.6%
Angry 3.5%
Confused 0.9%

AWS Rekognition

Age 31-41
Gender Male, 72.2%
Confused 63.4%
Calm 17.6%
Surprised 7.9%
Disgusted 7.4%
Fear 6.1%
Sad 3.5%
Happy 2.5%
Angry 2.1%

AWS Rekognition

Age 16-24
Gender Male, 95.9%
Calm 93.7%
Surprised 6.7%
Fear 6.1%
Sad 2.4%
Happy 2.2%
Disgusted 1%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 35-43
Gender Male, 98.3%
Sad 67.3%
Fear 45.5%
Happy 14.3%
Surprised 6.8%
Angry 4.9%
Disgusted 4.6%
Calm 4.4%
Confused 0.4%

AWS Rekognition

Age 36-44
Gender Male, 97.4%
Sad 99.3%
Surprised 12.8%
Disgusted 9.7%
Calm 8.5%
Fear 6.6%
Confused 4.4%
Happy 2.8%
Angry 2.2%

AWS Rekognition

Age 16-22
Gender Female, 84.4%
Calm 82.8%
Fear 8%
Surprised 6.5%
Sad 6.2%
Confused 1.9%
Angry 0.8%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Male, 94.1%
Calm 92.5%
Surprised 6.4%
Fear 6%
Sad 3.8%
Confused 1.2%
Disgusted 0.8%
Angry 0.5%
Happy 0.5%

AWS Rekognition

Age 19-27
Gender Male, 98.9%
Calm 87.6%
Fear 6.6%
Surprised 6.6%
Sad 3.4%
Happy 2.4%
Confused 2.1%
Angry 1.3%
Disgusted 0.8%

AWS Rekognition

Age 12-20
Gender Male, 91.7%
Sad 100%
Surprised 6.4%
Fear 6.2%
Calm 3.5%
Confused 2.1%
Angry 1.5%
Disgusted 1.3%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Female, 82.5%
Calm 38.5%
Happy 18.7%
Sad 15%
Fear 12.6%
Angry 7.5%
Surprised 7%
Confused 3.8%
Disgusted 3.1%

AWS Rekognition

Age 16-24
Gender Female, 54.5%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Confused 0.4%
Angry 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Male, 99.3%
Calm 55.4%
Sad 10.3%
Angry 9.8%
Confused 9.2%
Surprised 9.1%
Fear 7.9%
Disgusted 2.7%
Happy 1.8%

AWS Rekognition

Age 18-24
Gender Female, 61.7%
Calm 74.6%
Angry 16.6%
Surprised 6.4%
Fear 6.3%
Sad 4.1%
Happy 1.5%
Confused 0.9%
Disgusted 0.3%

AWS Rekognition

Age 16-22
Gender Male, 92.4%
Calm 97.7%
Surprised 6.3%
Fear 6%
Sad 2.3%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Male, 94%
Sad 97.1%
Calm 20%
Surprised 8.4%
Happy 7.8%
Fear 7.2%
Confused 6.9%
Disgusted 4.5%
Angry 2.4%

AWS Rekognition

Age 21-29
Gender Male, 96%
Sad 74.2%
Calm 19.8%
Angry 14%
Surprised 10.6%
Fear 9.4%
Happy 8.4%
Confused 5.5%
Disgusted 3.8%

AWS Rekognition

Age 22-30
Gender Male, 91.8%
Calm 68.6%
Surprised 8.8%
Fear 7%
Happy 6.1%
Sad 5.8%
Confused 4.6%
Disgusted 4.2%
Angry 2.3%

AWS Rekognition

Age 13-21
Gender Male, 86.3%
Calm 82.5%
Surprised 6.7%
Fear 6.1%
Angry 5.4%
Happy 4.2%
Sad 3.9%
Confused 1.2%
Disgusted 1%

AWS Rekognition

Age 16-24
Gender Male, 59.9%
Calm 80.4%
Surprised 6.9%
Fear 6.1%
Sad 5.5%
Confused 5.3%
Angry 4.1%
Disgusted 1%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Male, 91.7%
Calm 90.7%
Surprised 6.5%
Fear 6.1%
Sad 3.7%
Confused 1.4%
Angry 1.4%
Disgusted 1.1%
Happy 0.4%

AWS Rekognition

Age 22-30
Gender Male, 51.7%
Sad 100%
Calm 8.4%
Surprised 6.7%
Fear 6.1%
Happy 1.5%
Confused 0.8%
Disgusted 0.6%
Angry 0.4%

AWS Rekognition

Age 14-22
Gender Male, 89.5%
Calm 87.8%
Surprised 6.6%
Fear 6.3%
Sad 3.4%
Happy 2.9%
Angry 1.8%
Disgusted 1.2%
Confused 1.1%

Feature analysis

Amazon

Person 99.2%
Painting 90.9%

Captions

Microsoft
created on 2022-08-03

a store inside of a building 72%
a sign on the side of a building 56.8%
a sign above a store 56.7%

Text analysis

Amazon

St.
BOSTON
Lord,
Shaw
Washington
Shaw & Lord, 51 Washington St.
51
&
BOSTON VIEWS,
VIEWS,

Google

Shaw & Lord, 51 Washington St. SMHIA NOLSON
Shaw
&
Lord
,
51
Washington
St.
SMHIA
NOLSON