Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: Outside the Gymnasium
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2897.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: Outside the Gymnasium

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2897.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.6
Human 99.6
Person 99.5
Person 99.2
Person 99
Person 98.5
Person 98.1
Person 97.6
Person 97.3
Person 96.3
People 95.7
Person 95.5
Person 95.3
Person 94.6
Person 91.4
Military 90.7
Military Uniform 90.7
Armored 88.6
Army 88.6
Person 88.1
Apparel 85.2
Clothing 85.2
Helmet 85.2
Person 84.3
Nature 80.5
Soldier 76.3
Person 75.1
Person 70.5
Team 66.7
Outdoors 65.5
Countryside 63.8
Troop 59.2
Rural 59
Person 53.4
Person 44

Clarifai
created on 2019-06-05

people 100
military 99.3
many 98.7
group together 98.6
soldier 98.5
administration 98.5
group 98.4
uniform 97.9
war 97.9
adult 97.7
military uniform 94.8
outfit 94
man 93.1
leader 92.8
wear 92
child 91.9
rifle 87.2
weapon 86.4
boy 86.4
police 86.1

Imagga
created on 2019-06-05

military uniform 82.9
uniform 68.5
clothing 49.7
consumer goods 33.3
city 31.6
covering 31.6
architecture 26.5
building 25.4
old 21.6
street 21.1
tourism 19.8
travel 19
urban 17.5
wall 17.1
commodity 16.6
ancient 16.4
military 16.4
private 16.2
town 15.8
statue 15.5
historic 14.7
stone 14.6
history 14.3
door 13.4
soldier 12.7
sculpture 12.5
war 12.5
monument 12.1
house 11.8
army 11.7
religion 11.6
historical 11.3
culture 11.1
structure 11.1
window 10.7
brick 10.3
cemetery 10.2
gun 10.1
industrial 10
dirty 9.9
landmark 9.9
helmet 9.5
church 9.2
art 9.1
road 9
transportation 9
weapon 8.8
antique 8.6
construction 8.5
tourist 8.4
famous 8.4
vacation 8.2
man 8.1
facade 7.9
conflict 7.8
warrior 7.8
male 7.8
arch 7.7
industry 7.7
exterior 7.4
danger 7.3
aged 7.2

Google
created on 2019-06-05

People 94.3
Team 70.5
History 66.1
Crew 52.6
Family 52.5

Microsoft
created on 2019-06-05

clothing 98.5
posing 97.6
person 95.3
military uniform 94.4
group 92
outdoor 89.1
old 84.2
man 70.8
footwear 69.8
smile 66.6
clothes 16.2

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 9-14
Gender Female, 54.4%
Disgusted 45.3%
Calm 51.5%
Surprised 45.3%
Sad 46.9%
Confused 45.1%
Angry 45.4%
Happy 45.6%

AWS Rekognition

Age 16-27
Gender Male, 52.9%
Sad 47.8%
Confused 45.1%
Calm 51.6%
Disgusted 45.2%
Happy 45.2%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.9%
Sad 46%
Confused 45.1%
Calm 51.1%
Disgusted 45.9%
Happy 45.2%
Angry 46.3%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Surprised 45.2%
Confused 45.3%
Sad 47.2%
Disgusted 45.4%
Calm 49%
Angry 47.9%
Happy 45.1%

AWS Rekognition

Age 4-9
Gender Female, 53.2%
Calm 45%
Angry 45.2%
Disgusted 45%
Sad 54.6%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 38-57
Gender Female, 51.1%
Happy 45.1%
Surprised 45.2%
Calm 48.4%
Angry 45.3%
Confused 45.1%
Sad 50.5%
Disgusted 45.4%

AWS Rekognition

Age 4-9
Gender Female, 52.6%
Calm 48.4%
Happy 45.5%
Angry 48.5%
Sad 46.4%
Surprised 45.3%
Confused 45.1%
Disgusted 45.7%

AWS Rekognition

Age 10-15
Gender Male, 50.9%
Surprised 45.6%
Confused 45.8%
Sad 50.8%
Disgusted 45.5%
Calm 46%
Angry 45.6%
Happy 45.8%

AWS Rekognition

Age 48-68
Gender Female, 54%
Confused 45%
Angry 45%
Disgusted 45.1%
Surprised 45%
Sad 45%
Happy 54.5%
Calm 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51.7%
Surprised 45%
Confused 45%
Sad 54.5%
Calm 45%
Happy 45%
Disgusted 45%
Angry 45.4%

AWS Rekognition

Age 20-38
Gender Male, 53%
Angry 45.3%
Disgusted 45.2%
Sad 45.8%
Confused 45.1%
Happy 45.1%
Surprised 45.2%
Calm 53.2%

AWS Rekognition

Age 35-52
Gender Female, 52.5%
Confused 45.1%
Calm 45.4%
Angry 45.1%
Sad 46%
Happy 53.2%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Disgusted 45.1%
Confused 45.1%
Angry 52.7%
Calm 45.2%
Surprised 45.1%
Happy 45.1%
Sad 46.8%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Confused 45%
Calm 45%
Angry 45.2%
Sad 54.7%
Happy 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 14-25
Gender Female, 54.5%
Calm 52.5%
Surprised 45.4%
Disgusted 45.2%
Confused 45.2%
Happy 45.4%
Angry 45.4%
Sad 45.9%

AWS Rekognition

Age 10-15
Gender Female, 52.2%
Disgusted 45.2%
Confused 45.2%
Angry 45.4%
Calm 47.6%
Surprised 45.2%
Happy 45.4%
Sad 51.1%

AWS Rekognition

Age 35-52
Gender Female, 51.8%
Surprised 45.1%
Confused 45.2%
Happy 45.1%
Angry 45.3%
Calm 46.4%
Sad 52.4%
Disgusted 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Disgusted 45.6%
Calm 46.1%
Surprised 45.3%
Angry 45.8%
Sad 51.5%
Confused 45.3%
Happy 45.4%

AWS Rekognition

Age 29-45
Gender Male, 54.3%
Sad 53.4%
Disgusted 45.2%
Angry 46%
Surprised 45%
Calm 45.1%
Confused 45.2%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.1%
Angry 51.9%
Surprised 45.3%
Confused 45.1%
Sad 46%
Disgusted 45.6%
Happy 45.8%
Calm 45.2%

AWS Rekognition

Age 17-27
Gender Female, 51.8%
Confused 45.3%
Calm 47.3%
Happy 45.2%
Surprised 45.2%
Sad 50.9%
Angry 45.8%
Disgusted 45.3%

AWS Rekognition

Age 16-27
Gender Male, 54.7%
Surprised 45.3%
Calm 46.2%
Happy 45.1%
Sad 48.1%
Confused 46.6%
Angry 48.2%
Disgusted 45.5%

AWS Rekognition

Age 11-18
Gender Female, 52.1%
Surprised 45.1%
Sad 46.1%
Happy 45.1%
Disgusted 45.1%
Confused 45.1%
Calm 46.5%
Angry 51.9%

AWS Rekognition

Age 11-18
Gender Female, 54.8%
Happy 46.2%
Surprised 45.4%
Angry 45.8%
Sad 49.4%
Confused 45.3%
Disgusted 45.5%
Calm 47.5%

AWS Rekognition

Age 15-25
Gender Female, 54.1%
Sad 45.6%
Disgusted 45.2%
Surprised 45.1%
Angry 52.8%
Happy 45.5%
Calm 45.7%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 54%
Confused 45.1%
Calm 45.1%
Disgusted 45.1%
Happy 45.1%
Angry 45.5%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Angry 45.4%
Happy 45.2%
Disgusted 46.9%
Sad 45.2%
Confused 45.1%
Calm 52%
Surprised 45.2%

AWS Rekognition

Age 10-15
Gender Male, 51.8%
Disgusted 45%
Surprised 45.1%
Angry 45.3%
Confused 45.1%
Sad 45.1%
Calm 54.3%
Happy 45.1%

AWS Rekognition

Age 4-7
Gender Female, 52.6%
Sad 45.1%
Angry 54%
Calm 45.3%
Confused 45%
Happy 45.4%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 11-18
Gender Male, 51.2%
Sad 51.3%
Angry 46.5%
Calm 46.1%
Confused 45.6%
Happy 45.1%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Calm 47.6%
Angry 49.4%
Disgusted 45.1%
Sad 47.3%
Surprised 45.1%
Happy 45.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Calm 45.9%
Angry 45.4%
Disgusted 45.2%
Sad 51.8%
Surprised 45.3%
Happy 46.2%
Confused 45.2%

AWS Rekognition

Age 9-14
Gender Female, 54.6%
Confused 45.1%
Calm 45.2%
Angry 45.1%
Sad 45.4%
Happy 53.3%
Disgusted 46%
Surprised 45.1%

AWS Rekognition

Age 38-57
Gender Male, 53.2%
Surprised 45.2%
Happy 45.2%
Confused 45.1%
Sad 45.8%
Calm 47.7%
Disgusted 48.1%
Angry 47.8%

Microsoft Cognitive Services

Age 17
Gender Male

Feature analysis

Amazon

Person 99.6%
Helmet 85.2%

Categories

Imagga

streetview architecture 94.4%
paintings art 4.5%

Text analysis

Amazon

S