You don't need to compile the engine from zero, just the godot-headers. It's really fast, on my modest machine it took about 5 minutes if I use the -j4 flag to use 4 CPU cores. After that, you only have to compile your code, and that is usually seconds.