How do one loses approval/limitless privileges?

Simply by being inactive? Or are there other factors?

The main way is being inactive. If you approve fewer than 30 posts every 45 days you are eligible for automatic demotion. Otherwise you'd have to be demoted manually by a mod or admin.