> we really want those border checks back
Why? You don’t need to be in the EU to belong to Shengen.
Norway is not EU, it's EEA, which is more like what you describe (the population rejected joining twice in referendums, but the politicians still wanted some treaties).
You are unironically using 'vacation destinations' as argument for modifying your legal system to fit foreign lobbying needs. All is lost.