Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Philadelphia. H. J. Heinz Company: Blue Ribbon Team

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2342

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Pennsylvania. Philadelphia. H. J. Heinz Company: Blue Ribbon Team

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Horse 99.1
Mammal 99.1
Animal 99.1
Machine 99.1
Wheel 99.1
Horse 98.8
Wheel 98.7
Transportation 98.7
Vehicle 98.7
Horse Cart 98.7
Wagon 98.7
Wheel 97
Person 96.3
Human 96.3
Horse 81.2
Horse 67.7
Carriage 58.3

Clarifai
created on 2019-06-04

people 99.9
cavalry 98.9
print 97.8
adult 97.3
vehicle 96.9
man 96.7
group 95.6
illustration 95.4
carriage 95.3
engraving 95.1
transportation system 94.9
military 93.9
seated 93.4
two 93.3
one 92.6
lithograph 91.3
leader 90.3
administration 90.3
war 89.7
group together 88.1

Imagga
created on 2019-06-04

carriage 95.2
transportation 28.7
old 27.2
cart 25.6
transport 24.6
horse cart 24.3
harness 23.1
wagon 20.8
vehicle 20.2
antique 18.3
horse 17.1
wheel 17
device 16.6
vintage 16.5
support 15.4
travel 14.8
retro 13.9
street 12.9
bicycle 12.8
power 12.6
history 12.5
plow 12.1
city 11.6
wheeled vehicle 11.6
bike 10.7
grunge 10.2
ride 9.7
black 9
drawing 8.9
steel 8.8
wheels 8.8
man 8.7
outdoor 8.4
tool 8.3
sky 8.3
speed 8.2
road 8.1
metal 8
building 7.9
architecture 7.8
ancient 7.8
engine 7.7
train 7.7
track 7.7
historical 7.5
house 7.5
locomotive 7.4
tourist 7.2
holiday 7.2
farm 7.1

Google
created on 2019-06-04

Horse and buggy 95.4
Horse 93.9
Horse harness 90.4
Vehicle 89.8
Coachman 89.3
Carriage 87.7
Cart 86.4
Wagon 83.4
Rein 63.6
Working animal 54.4

Microsoft
created on 2019-06-04

horse 100
drawn 99.7
carriage 95
old 88.1
animal 79
horse and buggy 77
coachman 60.6
land vehicle 60
pulling 57.6
cart 57.6
wagon 57
horse harness 54.2
rein 50.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Calm 45.2%
Happy 45.7%
Sad 49.8%
Surprised 45.6%
Disgusted 46.3%
Angry 46.9%
Confused 45.5%

AWS Rekognition

Age 4-9
Gender Female, 50.5%
Disgusted 49.5%
Calm 49.5%
Happy 49.5%
Angry 49.5%
Sad 50.3%
Confused 49.5%
Surprised 49.5%

Feature analysis

Amazon

Horse 99.1%
Wheel 99.1%
Person 96.3%

Captions

Microsoft

a person riding a horse drawn carriage 96.6%
an old photo of a person riding a horse drawn carriage 95.7%
old photo of a person riding a horse drawn carriage 94.6%

Text analysis

Amazon

RIBBON
BLUE RIBBON TEAM
BLUE
TEAM
THEIN
PITE

Google

Co
TIDEPICKL
AHEINZ Co TIDEPICKL PRESERLING NG BLUE RIBBON TEAM
AHEINZ
NG
PRESERLING
RIBBON
TEAM
BLUE