Yes, the plant will only hold a certain number, others will yellow/wither at the 1" to 2" stage. Pick the mature ones and more will set - best to pick them as small as is sensible for use