If your quad goes up fast when you switch ATTI -> MAN, it has a power/weight ratio that is very high. In other words it would probably hover with a throttle way lower than 50 %.
While you're in ATTI mode you will not realize that since it is being managed by the brain: 50 % of your stick is...