Giving the physics a chance: how to reduce the impact of numerical errors