Unlocking Residual Spaces and Creating In-between