Blight survives in infected plant material. This is how it over-winters. It is generally considered that potato tubers are the main source of re-infection.

Make sure that all the tubers (however small) and foliage, are disposed of properly.

Use the compost on the garden, there should be no problem.