No, they have not. Though compasses always point to the magnetic pole, the magnetic pole has not always been in the north. Every 300,000 to 1 million years, the magnetic pole flips from north to south or from south to north. If compasses had been around before the last time the magnetic pole reversed, their arrows would have pointed south rather than north.