I do exactly this. You can run the whole thing on a PI. I have actually installed asahi Linux on my Mac and I connect to it remotely so you can be sure I will never upgrade my Mac again because it’s already overbuilt.