An update...
After replacing both the IMU and the PMU, the RTH problem is now solved. Same firmware, same mcu, same hardware setup, just a straight switch of those components and all is as it should be, no more crazy bucking on RTH.
So, for all those that have the same problem, (I have been...