I have no idea. It may be a couple of factors: The craft's balance, build, wind, GPS strength. How does your craft hold in GPS mode? You should have a rock solid hold without the " toilet bowl" effect before you use the RTH feature.
I use the RTH for recovery and land it myself. I would...