Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: The Dump. A prominent politician receives fifty cents a load for every load of refuse deposited by the City in the hole made by this brick yard.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2901.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.: The Dump. A prominent politician receives fifty cents a load for every load of refuse deposited by the City in the hole made by this brick yard.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.9
Human 99.9
Person 99.7
Person 99.4
Person 97.5
Soil 94.6
Outdoors 72
Military 69.3
Military Uniform 69.3
Person 68.1
Nature 66.8

Clarifai
created on 2019-06-05

people 99.9
group together 99.8
adult 99.4
war 99.1
group 99.1
military 99
soldier 98.8
several 97.7
man 97.6
two 97.2
many 96.6
four 95.9
skirmish 95.6
one 93.8
three 93.7
waste 93.7
administration 93.2
weapon 93.1
five 91.5
gun 91.5

Imagga
created on 2019-06-05

sand 52
beach 36.8
sea 28.2
vacation 27.8
summer 23.2
ocean 22.7
travel 22.5
man 21.5
sky 20.4
water 19.4
person 18.1
soil 18
outdoors 17.6
walking 17.1
mountain 16.9
people 16.7
sport 16.6
outdoor 16.1
earth 15.9
leisure 15.8
landscape 15.6
active 15.4
coast 14.4
male 13.6
relax 13.5
adventure 13.3
child 12.3
holiday 12.2
adult 11.7
family 11.6
hiking 11.6
boy 11.3
shore 11.3
sun 11.3
two 11
extreme 10.5
sunny 10.3
lifestyle 10.1
happy 10
enjoy 9.4
happiness 9.4
desert 9.3
mountains 9.3
relaxation 9.2
joy 9.2
exercise 9.1
horizon 9
activity 9
scenic 8.8
hike 8.8
planner 8.7
men 8.6
walk 8.6
clouds 8.5
shovel 8.4
top 8.3
fun 8.2
recreation 8.1
natural 8
farm 8
hiker 7.9
couple 7.8
run 7.7
outside 7.7
tropical 7.7
engineer 7.5
coastline 7.5
holidays 7.5
joyful 7.4
father 7.3
women 7.1
kid 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

outdoor 98.6
ground 98
clothing 97.3
person 85.7
man 84.9
hiking 70.4
people 65.3
group 63
weapon 52.2
sandy 11.5

Face analysis

Amazon

Google

AWS Rekognition

Age 35-52
Gender Male, 53.3%
Sad 51.8%
Confused 45.1%
Calm 45.2%
Disgusted 45.1%
Happy 45%
Angry 47.7%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Calm 45.2%
Angry 45.2%
Confused 45.1%
Sad 45.1%
Happy 45.1%
Disgusted 54.1%
Surprised 45.2%

AWS Rekognition

Age 29-45
Gender Male, 53.5%
Sad 45.2%
Surprised 45%
Angry 45%
Disgusted 45%
Confused 45%
Happy 54.5%
Calm 45.1%

AWS Rekognition

Age 57-77
Gender Female, 50.2%
Surprised 49.6%
Confused 49.6%
Sad 49.6%
Disgusted 49.6%
Calm 49.7%
Angry 49.7%
Happy 49.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people standing in the dirt 91.9%
a group of people that are standing in the dirt 89.1%
a group of people standing in the sand 89%