Is You Diffusion Model Actually Denoising?