Have you ever driven near the border? You'll be flagged for doing anything out of the ordinary with your car. If you have to pull over for a moment to find your passport for example, or if you made a wrong turn and try to turn around, or really anything that looks "suspicious", you risk getting additional searches or being pulled over.