Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. University of Chicago Settlement: Trying to have a garden. These trees could not live because of the smoke and gas from "The Yards."
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.30.1

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. University of Chicago Settlement: Trying to have a garden. These trees could not live because of the smoke and gas from "The Yards."

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.7
Human 99.7
Person 99.6
Person 98.8
Person 98.8
Person 98.8
Person 98.6
Person 98.6
Playground 94.1
Play Area 94.1
Person 81.2
Outdoors 78.6
People 73.8
Person 70.2
Person 63.2
Person 57.7
Person 47.5

Clarifai
created on 2019-06-05

people 100
group 99.8
many 99.5
group together 99.5
adult 99.3
war 97.6
home 97.5
military 97
several 96.8
man 96.2
child 95.7
administration 95
soldier 93
vehicle 93
woman 92.7
wear 92.6
outfit 91.6
skirmish 91.5
two 89.8
leader 89.7

Imagga
created on 2019-06-05

tree 36.3
forest 29.6
snow 28.8
trees 28.5
winter 25.5
resort area 25.1
landscape 24.5
park 23.2
area 21.2
cold 19.8
outdoor 18.3
old 18.1
season 17.9
rural 16.7
outdoors 15.9
region 15.9
wood 15.8
autumn 15.8
snowy 15.6
scenery 15.3
sky 15.3
scenic 14
woods 13.4
country 12.3
travel 12
seasonal 11.4
light 11.4
peaceful 11
countryside 11
fall 10.9
river 10.7
frost 10.6
structure 10.5
path 10.4
scene 10.4
vehicle 10.4
track 10
road 9.9
location 9.9
environment 9.9
transportation 9.9
sport 9.6
frozen 9.6
plant 9.6
outside 9.4
field 9.2
house 9.2
fun 9
shovel 8.7
covered 8.7
natural 8.7
yellow 8.6
conveyance 8.2
recreation 8.1
mountain 8
tourist 8
new england 7.9
people 7.8
leaf 7.8
train 7.7
building 7.7
city 7.5
vascular plant 7.5
vintage 7.4
vacation 7.4
street 7.4
new 7.3
morning 7.2
tool 7.1
pine 7
leaves 7

Google
created on 2019-06-05

Tree 86
Adaptation 67
Child 61.3
Arbor day 61.2
Plant 58.5
House 53.7
Pole 51.5

Microsoft
created on 2019-06-05

tree 99.7
outdoor 99.7
grass 97.5
person 76.4
old 73.5
group 70.2
people 63.4
clothing 57.3
plant 50.4
posing 45.3

Face analysis

Amazon

AWS Rekognition

Age 11-18
Gender Female, 54.7%
Surprised 45%
Happy 45%
Confused 45.1%
Calm 46.1%
Disgusted 45.1%
Angry 45.6%
Sad 53.1%

AWS Rekognition

Age 4-7
Gender Female, 52.5%
Calm 45.1%
Surprised 45.1%
Disgusted 45.2%
Angry 45.8%
Happy 45%
Sad 53.5%
Confused 45.2%

AWS Rekognition

Age 4-9
Gender Female, 54%
Angry 47.7%
Surprised 45.2%
Happy 45.5%
Disgusted 45.8%
Sad 46.1%
Confused 45.7%
Calm 49%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Confused 45.1%
Surprised 45.3%
Sad 45.3%
Calm 47.2%
Happy 45.1%
Angry 46.2%
Disgusted 50.9%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Angry 45.4%
Happy 45.2%
Surprised 47.1%
Disgusted 45.1%
Sad 45.4%
Confused 45.3%
Calm 51.4%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Calm 50.3%
Surprised 49.6%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.6%
Sad 46.1%
Disgusted 45.2%
Surprised 45.5%
Happy 45.7%
Confused 46.6%
Calm 48.6%
Angry 47.3%

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 92.5%
a vintage photo of a group of people sitting on a horse 92.4%
a vintage photo of a group of people posing for a picture 92.3%