Manifold mapping optimization with of without true gradients