Rosemary and sage are excellent for planting and leaving. Possibly thyme also, although I never have much success with keeping it going over the winter. For many of the perennial herbs you may be better buying a couple of plants or getting some cuttintgs from someone locally rather than trying to raise from seed, as it's probably not worth the effort. Another option is mint, but it may not be a good idea to plant it directly in the ground as it is pretty invasive, better in a pot or planter. Chives are good too - you get pretty flowers and can raise from seed. I'm trying garlic chives this year and I quite fancy having a go at wild garlic next year.

Other possibilities might include herbs that are annuals but self-seed e.g. borage (good in Pimms apparently, although this is a new one on me this year), or edible flowers like nasturtiums or calendula.

__________________
Warning: I have a dangerous tendency to act like I know what I'm talking about.