Health food shops are a good source of spices such as mustard seed, cinnamon (powder or sticks) etc. Also ethnic shops which sell an incredible range of ingredients at really good prices - don't be afraid to ask, people are usually really helpful. I usually add cloves to my pickles and chutneys (and apple pies), they give a lovely warm spicy flavour.