Also you never pull anything out or stop for these people

They are just trying to divert your attention to pickpocket you, or straight up grab your phone and run. A practiced thief can take the Rolex off your wrist in half a second