Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Pittsburgh. H.J. Heinz Company: Daily Drives in the Parks.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.369

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Pittsburgh. H.J. Heinz Company: Daily Drives in the Parks.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Horse 99.7
Mammal 99.7
Animal 99.7
Vehicle 98.7
Carriage 98.7
Transportation 98.7
Horse 97.6
Machine 97.5
Wheel 97.5
Horse Cart 94.8
Wagon 94.8
Wheel 94.4
Tower 80.8
Clock Tower 80.8
Architecture 80.8
Building 80.8
Human 65.1
Person 65.1
Person 60.6

Clarifai
created on 2019-06-05

people 99.8
transportation system 98.2
vehicle 97.2
adult 96.9
carriage 96.7
man 95.4
cavalry 95.4
group 93.2
military 91.3
group together 91.2
administration 90
many 86.4
leader 86.4
woman 84.8
street 84.6
wagon 84.4
two 83.5
war 83.4
driver 81
cart 79.5

Imagga
created on 2019-06-05

carriage 100
horse cart 57.9
cart 50.9
wagon 36.4
wheeled vehicle 22.5
old 21.6
horse 19
city 18.3
vehicle 18.1
transportation 17
outdoors 15.7
architecture 15.6
travel 15.5
wheel 14.1
park 13.2
sky 12.8
rural 12.3
vacation 12.3
chair 11.8
farm 11.6
man 11.4
trees 10.7
building 10.3
summer 10.3
landscape 9.7
sun 9.7
urban 9.6
people 9.5
day 9.4
tree 9.2
male 9.2
outdoor 9.2
transport 9.1
tourist 9.1
fountain 8.8
country 8.8
water 8.7
wheelchair 8.5
house 8.4
street 8.3
historic 8.2
grass 7.9
horses 7.8
antique 7.8
color 7.8
ancient 7.8
outside 7.7
horizontal 7.5
tourism 7.4
bench 7.3
road 7.2
landmark 7.2
sunset 7.2
history 7.2
animal 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

horse 99.9
drawn 99.4
carriage 99.4
building 99.3
outdoor 98.7
old 91.6
animal 91.5
horse and buggy 80.2
cart 78.7
pulling 76.3
rein 64.6
coachman 64.3
horse harness 61.4
land vehicle 59.7
horse tack 57.2
wagon 56
bridle 55.4
mare 51.7
horse supplies 51.7
pulled 28.9

Face analysis

Amazon

AWS Rekognition

Age 27-44
Gender Female, 50.3%
Sad 49.9%
Confused 49.5%
Surprised 49.5%
Happy 49.6%
Angry 49.5%
Disgusted 49.8%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 49.7%
Disgusted 49.7%
Happy 49.7%
Confused 49.5%
Surprised 49.5%
Sad 49.8%
Angry 49.6%

AWS Rekognition

Age 35-53
Gender Male, 50.2%
Angry 49.6%
Calm 49.6%
Disgusted 49.5%
Surprised 49.6%
Sad 50.1%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Sad 50.5%
Angry 49.5%

Feature analysis

Amazon

Horse 99.7%
Wheel 97.5%
Clock Tower 80.8%
Person 65.1%

Captions

Microsoft

a person riding a horse drawn carriage in front of a building 97.4%
a person riding a horse drawn carriage 97.3%
an old photo of a horse drawn carriage in front of a building 97.2%

Text analysis

Amazon

DRIVES
DAILY
PARKS
THE PARKS
THE
DAILY DRIVES IN
IN
HHeinz
HHeinz C9
C9

Google

DAILY
DRIVES
IN
THE
DAILY DRIVES IN THE PARKS
PARKS