I feel like someone got away with that once and the airline smartened up. More power to you if it's possible though.
Yes, it is a valid concern, I had units call me a week in advance to come out for an interview.. not much notice. Fortunately my other career allows me to work remotely so I kind of just disappeared for a week, but obviously you cant do that when you're flying.