To the best of my understanding the garden fruits are perfectly safe to use, and no greater difference from 'bought' ones than between the apple tree in your garden and the 'self-seeded' semi-crab apple in the hedgerow (where someone threw away the core...) They may have a different flavour (not tried either myself, but I've met people who use the garden ones) as the 'feral' apples do.

__________________
Flowers come in too many colours to see the world in black-and-white.