OGPO: Sample Efficient Full-Finetuning of Generative Control Policies