Are we assuming x64? Many ARM systems have gaps in their physical address space. x64 can too but not always. For example the Gameboy Advance used the top 8 bits of the address to identify the peripheral that is accessed.