Get as much of the roots out as you can. Glyphosate promises to kill the roots too, but it may need several applications and a lot of time. However if you dig thoroughly and remove what you can, if it does re-grow it should be a lot easier to remove (small plants, rather than a tangled mass)