Your tree is very young, and needs time to establish itself before it will flower and fruit regularly. Is it in a pot or in the open ground? Victoria turns into quite a large tree so is probably not suitable for pot growing.