I’ve done it twice so far (main server and a Raspberry Pi). Although I recall I had some package breakage with the main server (some changes in Podman that did not go well with the migration to pasta, the new rootless network stack), the process was mostly pain free and I could fix things remotely with SSH.