A device’s location shouldn't matter. Boot Manager software that's built into Windows should help. The problem could be a few things to check out.

What is Last BIOS Time? How to check BIOS boot time? Can you reduce or decrease BIOS Time, if it is high in Windows 11/10? Get the details here.

Learn about Audit Mode in Windows 11/10, and how it helps OEM to deploy same image to multiple computers. Also learn how to boot into or out of Audit Mode.