Human Generated Data

Title

Social Settlements: Great Britain, England. London. "Toynbee Hall": Toynbee Hall: Smoking Debate in Lecture Hall (Held Every Thursday)

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3578.3

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "Toynbee Hall": Toynbee Hall: Smoking Debate in Lecture Hall (Held Every Thursday)

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3578.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 100
Audience 100
Crowd 100
Person 99.1
Person 98.6
Person 98.3
Person 98.1
Person 97.9
Person 97.9
Person 95.4
Person 95.2
Person 93.8
Person 92.2
Person 91.3
Person 90.1
Speech 89.8
Lecture 80.8
Indoors 79.1
Person 78.6
Hall 56.3

Clarifai
created on 2019-06-05

people 99.9
many 99.9
group together 99.3
group 99.3
adult 98.1
crowd 97.3
man 95.9
school 95.9
wear 95.6
uniform 95.5
military 95.1
leader 94.9
outfit 94.8
woman 94.4
administration 94.3
education 93
spectator 86.3
ceremony 85.4
war 84
boy 83.4

Imagga
created on 2019-06-05

military uniform 41.3
clothing 40.7
uniform 33.6
mortarboard 28.7
covering 25.3
consumer goods 24.5
cap 23.6
hall 22.6
group 20.9
people 20.6
headdress 17.6
crowd 16.3
entrepreneur 16
travel 14.8
business 14.6
men 13.7
man 12.1
city 11.6
animal 11.3
building 11.2
landscape 11.1
person 10.7
bird 10.2
life 9.9
student 9.8
interior 9.7
urban 9.6
women 9.5
walking 9.5
row 9.3
industry 8.5
old 8.4
prison 8.3
tourism 8.2
commodity 7.9
standing 7.8
station 7.7
sky 7.6
academic gown 7.6
south 7.5
room 7.4
silhouette 7.4
many 7.4
farm 7.1
male 7.1

Google
created on 2019-06-05

Team 70.5
Event 62.7
Crowd 62.7
Crew 60.2
Non-commissioned officer 53.1
Troop 52

Microsoft
created on 2019-06-05

clothing 93.6
person 90.6
black 85.1
man 79.9
group 78.6
posing 78.4
old 69.1
team 26.1
clothes 21.6
crowd 1.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Calm 49.6%
Disgusted 45.3%
Sad 46.1%
Angry 45.5%
Happy 45.8%
Surprised 47%
Confused 45.7%

AWS Rekognition

Age 38-59
Gender Male, 54.9%
Calm 51.9%
Sad 46.5%
Surprised 45.1%
Disgusted 45.2%
Happy 45.1%
Angry 45.6%
Confused 45.5%

AWS Rekognition

Age 49-69
Gender Male, 54.7%
Angry 45.8%
Confused 45.3%
Calm 52.2%
Disgusted 45.3%
Sad 45.7%
Surprised 45.2%
Happy 45.4%

AWS Rekognition

Age 45-65
Gender Male, 54.8%
Sad 46.7%
Disgusted 45%
Calm 52.9%
Confused 45.1%
Angry 45.2%
Surprised 45.1%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Confused 45.3%
Sad 45.1%
Calm 50.6%
Happy 45.6%
Angry 45.2%
Surprised 45.3%
Disgusted 47.9%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Calm 46.8%
Sad 51.3%
Surprised 45.3%
Disgusted 45.3%
Angry 45.7%
Happy 45.1%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Disgusted 45%
Confused 45.1%
Surprised 45.3%
Calm 45.3%
Happy 53.2%
Angry 45.2%
Sad 45.9%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Confused 45.5%
Sad 50.6%
Angry 45.8%
Calm 46.8%
Happy 45.3%
Disgusted 45.2%
Surprised 45.7%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Disgusted 45.3%
Angry 45.8%
Happy 45.2%
Surprised 45.3%
Confused 46%
Calm 50.6%
Sad 46.9%

AWS Rekognition

Age 35-53
Gender Male, 54.9%
Angry 45.5%
Surprised 45.1%
Sad 51.7%
Disgusted 45.1%
Confused 45.3%
Happy 45.2%
Calm 47.1%

AWS Rekognition

Age 30-47
Gender Male, 55%
Angry 46.3%
Calm 48.8%
Confused 46.2%
Sad 46.8%
Disgusted 45.3%
Happy 46.3%
Surprised 45.3%

AWS Rekognition

Age 23-38
Gender Male, 50.2%
Angry 49.9%
Calm 49.7%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Disgusted 49.5%
Surprised 49.6%

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Disgusted 45.6%
Angry 46.5%
Happy 45.7%
Surprised 45.6%
Confused 46.2%
Calm 49.4%
Sad 46%

AWS Rekognition

Age 17-27
Gender Male, 50.3%
Calm 49.7%
Disgusted 49.5%
Confused 49.6%
Angry 49.6%
Sad 50.1%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Sad 49.9%
Calm 49.5%
Surprised 49.5%
Confused 49.6%
Angry 49.6%
Disgusted 49.8%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Female, 54.2%
Angry 45.3%
Sad 54.2%
Disgusted 45.2%
Calm 45.1%
Happy 45.1%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 48-68
Gender Male, 50.4%
Angry 49.7%
Calm 49.8%
Surprised 49.5%
Disgusted 49.8%
Happy 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Disgusted 49.7%
Surprised 49.6%
Sad 49.6%
Calm 49.8%
Angry 49.7%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Male, 54.3%
Sad 45.3%
Disgusted 45.3%
Confused 45.6%
Happy 45.7%
Calm 49.9%
Surprised 47.6%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 55%
Calm 48.4%
Disgusted 45.5%
Sad 48.9%
Angry 45.8%
Happy 45.1%
Surprised 45.3%
Confused 46%

AWS Rekognition

Age 38-59
Gender Male, 50.2%
Disgusted 49.5%
Sad 49.9%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.9%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Confused 49.5%
Surprised 49.5%
Angry 49.5%
Calm 50.2%
Sad 49.5%
Happy 49.5%
Disgusted 49.7%

AWS Rekognition

Age 27-44
Gender Male, 50.2%
Confused 49.6%
Calm 49.6%
Angry 49.6%
Surprised 49.6%
Sad 49.7%
Happy 49.9%
Disgusted 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50.5%
Confused 49.5%
Sad 50.1%
Surprised 49.5%
Disgusted 49.5%
Calm 49.7%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 45.7%
Confused 45.1%
Disgusted 45.9%
Sad 45.2%
Calm 51.9%
Angry 45.7%
Surprised 45.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.4%
Angry 49.6%
Calm 49.5%

AWS Rekognition

Age 27-44
Gender Male, 54.9%
Calm 48.8%
Disgusted 45.2%
Confused 45.9%
Angry 46.2%
Sad 46.9%
Surprised 45.5%
Happy 46.5%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Angry 49.6%
Sad 50%
Confused 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.6%
Happy 49.7%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Angry 49.6%
Surprised 49.5%
Sad 50.1%
Disgusted 49.6%
Confused 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 45-65
Gender Male, 54.8%
Calm 47.4%
Confused 46.3%
Disgusted 45.6%
Happy 46.4%
Angry 45.9%
Sad 45.9%
Surprised 47.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.7%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Calm 50.1%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Male, 50.4%
Sad 50.3%
Happy 49.5%
Angry 49.6%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 49.6%
Disgusted 49.8%
Happy 49.7%
Angry 49.7%
Surprised 49.6%
Calm 49.5%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.1%
Surprised 49.5%
Confused 49.5%
Sad 49.8%
Calm 50%
Disgusted 49.6%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 35-53
Gender Male, 50.4%
Confused 49.6%
Surprised 49.5%
Angry 49.6%
Calm 49.5%
Sad 50.3%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 4-9
Gender Male, 50.4%
Calm 49.8%
Sad 49.6%
Confused 49.6%
Angry 49.7%
Disgusted 49.7%
Happy 49.5%
Surprised 49.6%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Sad 45.7%
Disgusted 45.5%
Confused 45.6%
Happy 46.1%
Calm 48.2%
Surprised 47.8%
Angry 46%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Angry 49.6%
Calm 49.6%
Surprised 49.7%
Disgusted 49.6%
Happy 49.7%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Male, 50.4%
Sad 50%
Happy 49.6%
Confused 49.6%
Disgusted 49.6%
Calm 49.6%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50.4%
Angry 49.7%
Sad 49.6%
Surprised 49.6%
Confused 49.7%
Disgusted 49.6%
Calm 49.7%
Happy 49.5%

AWS Rekognition

Age 29-45
Gender Male, 53.3%
Sad 46.7%
Surprised 45.6%
Happy 45.1%
Angry 49.9%
Confused 45.3%
Disgusted 45.4%
Calm 47%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Calm 49.9%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Sad 49.8%
Surprised 49.5%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.6%
Sad 49.8%
Disgusted 49.6%
Calm 49.7%
Surprised 49.5%
Confused 49.7%
Happy 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Surprised 49.6%
Confused 49.6%
Happy 49.6%
Calm 49.5%
Disgusted 49.9%
Sad 49.7%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 50.3%
Happy 49.5%
Sad 49.6%
Confused 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Confused 46.6%
Sad 46.8%
Surprised 46.4%
Disgusted 45.3%
Calm 48.1%
Happy 45.2%
Angry 46.5%

AWS Rekognition

Age 35-55
Gender Male, 54.6%
Calm 46%
Angry 45.6%
Sad 51.7%
Happy 45.3%
Surprised 45.5%
Confused 45.6%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 46.7%
Angry 45.6%
Surprised 45.3%
Happy 47.3%
Sad 48.8%
Calm 45.6%
Confused 45.7%

AWS Rekognition

Age 15-25
Gender Female, 54.1%
Sad 47.1%
Calm 49.2%
Surprised 45.6%
Disgusted 45.1%
Angry 45.5%
Happy 45.2%
Confused 47.4%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Surprised 49.5%
Sad 49.8%
Calm 49.8%
Happy 49.7%
Confused 49.5%
Angry 49.6%
Disgusted 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Confused 49.5%
Sad 49.9%
Calm 49.6%
Happy 49.8%
Angry 49.6%
Surprised 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 49.6%
Confused 49.5%
Calm 50.1%
Surprised 49.7%
Sad 49.5%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 30-47
Gender Male, 50.5%
Surprised 49.5%
Angry 49.6%
Calm 49.6%
Disgusted 49.6%
Confused 49.6%
Happy 49.5%
Sad 50.1%

AWS Rekognition

Age 35-55
Gender Male, 50.4%
Angry 49.6%
Happy 49.8%
Surprised 49.6%
Disgusted 49.6%
Sad 49.7%
Confused 49.6%
Calm 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Confused 49.5%
Surprised 49.5%
Happy 49.6%
Sad 50.2%
Calm 49.5%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 48-68
Gender Male, 50.5%
Calm 49.6%
Angry 49.6%
Sad 50.2%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.8%
Confused 45%
Sad 54.1%
Surprised 45%
Disgusted 45.1%
Calm 45.3%
Happy 45.2%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Sad 45.3%
Disgusted 45.1%
Happy 53.3%
Surprised 45.1%
Angry 45.2%
Calm 45.8%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Confused 49.5%
Sad 49.7%
Angry 49.6%
Calm 50%
Happy 49.7%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.6%
Happy 49.9%
Calm 49.6%
Angry 49.6%
Sad 49.7%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 45-63
Gender Male, 50.5%
Disgusted 49.6%
Happy 49.7%
Calm 49.7%
Angry 49.6%
Surprised 49.5%
Confused 49.5%
Sad 49.8%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Calm 49.7%
Confused 49.5%
Happy 49.5%
Disgusted 50.1%
Angry 49.6%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 29-45
Gender Female, 50.1%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.4%

AWS Rekognition

Age 48-68
Gender Female, 50.4%
Surprised 49.5%
Confused 49.6%
Happy 49.5%
Calm 49.6%
Disgusted 49.6%
Sad 50.1%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.5%
Angry 49.7%
Surprised 49.5%
Confused 49.5%
Sad 50%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Sad 49.7%
Surprised 49.6%
Happy 49.6%
Angry 49.6%
Confused 49.6%
Disgusted 49.7%
Calm 49.7%

AWS Rekognition

Age 45-66
Gender Female, 50.5%
Disgusted 49.5%
Confused 49.6%
Surprised 49.5%
Calm 50%
Happy 49.6%
Angry 49.5%
Sad 49.7%

AWS Rekognition

Age 29-45
Gender Female, 50.2%
Surprised 49.5%
Sad 50.4%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 38-59
Gender Male, 54.2%
Happy 45.2%
Confused 45.3%
Disgusted 45.2%
Sad 45.3%
Calm 45.5%
Angry 53.1%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Calm 49.6%
Sad 49.9%
Surprised 49.6%
Disgusted 49.6%
Angry 49.8%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 35-55
Gender Female, 50.1%
Surprised 49.5%
Disgusted 49.5%
Calm 49.5%
Sad 50.5%
Confused 49.5%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Sad 49.7%
Disgusted 49.6%
Confused 49.6%
Happy 49.5%
Calm 49.6%
Surprised 49.6%
Angry 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.9%
Calm 49.5%
Angry 49.7%
Disgusted 49.5%
Surprised 49.6%
Confused 49.5%
Happy 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.6%
Surprised 49.5%
Happy 49.5%
Sad 49.8%
Calm 50%
Disgusted 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 49.5%
Sad 50.2%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Angry 49.7%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50%
Surprised 49.5%
Happy 49.5%
Angry 49.6%
Confused 49.5%
Disgusted 49.5%
Calm 49.8%

AWS Rekognition

Age 35-52
Gender Male, 51.4%
Surprised 45%
Happy 45.1%
Angry 46.3%
Calm 45.1%
Confused 45.1%
Sad 53.4%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Confused 49.5%
Happy 49.6%
Calm 49.8%
Disgusted 49.6%
Sad 50%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Happy 49.5%
Disgusted 50.5%
Surprised 49.5%
Angry 49.5%
Sad 49.5%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Sad 50.2%
Disgusted 49.5%
Happy 49.6%
Surprised 49.5%
Angry 49.6%
Calm 49.5%
Confused 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.1%
Calm 50.3%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Sad 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%
Calm 49.7%
Angry 49.6%
Sad 50%
Happy 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Sad 49.7%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Angry 49.6%
Calm 50.1%
Confused 49.6%

AWS Rekognition

Age 48-68
Gender Female, 50.4%
Angry 49.5%
Sad 50.1%
Disgusted 49.5%
Calm 49.8%
Happy 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Confused 49.5%
Happy 49.8%
Sad 49.6%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 50%

AWS Rekognition

Age 11-18
Gender Male, 50.4%
Calm 49.7%
Surprised 49.5%
Angry 49.6%
Sad 50%
Confused 49.6%
Disgusted 49.5%
Happy 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Surprised 49.6%
Sad 49.6%
Calm 50%
Happy 49.6%
Confused 49.6%
Angry 49.6%
Disgusted 49.5%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%