Once home to fishermen, Pyms Gardens was known for its pungent smells, poor sanitation and tough living conditions.