Neutrality was the official lie in some of those countries at that time. When US bomber crewmen and Luftwaffe pilots bailed out over Switzerland, the US guys would be interned and somehow the Luftwaffe guys would find their way back into Germany pretty quickly. The Swiss may have been officially neutral, but they were very Nazi sympathetic.
Likewise when the occasional B-24 or B-17 couldn't make it across the Atlantic on a ferry flight and had to land on a beach in western Ireland, the crew would be "interned" for the train ride as far as Dublin where they were put on the next boat to Great Britain. The crew of one B-24 was held for a whole week and part of their prisoners rations included a fifth of whiskey per day for the crew. They had to be repatriated so that they wouldn't drink the county dry.