Pathologies and Challenges of Using Differentiable Simulators in Policy Optimization for Contact-Rich Manipulation