But it was the Duke's work commitments with the military, and the media focus on the Duchess, which eventually led to their marriage breakdown, with the royal couple splitting in 1992, and then divorcing in 1996.
Their separation has always been amicable, with the Duke and Duchess living in the Duke's Sunninghill Park home until 2004, when Andrew moved to the nearby Royal Lodge.
However, royal fans have now uncovered clues dating back to that time, that seem to show Prince Andrew's plans to reconcile with his ex wife.
It turns out that after a 2003 security breach at the Duke of York's personal apartment at Buckingham Palace, photos of the rooms showed some surprising clues to Andrew's feelings for Fergie.
The Duke kept photos of Sarah in the royal suite, as well as a cushion embroidered with the phrase "Eat, Drink and Re Marry", according to the Express article at the time.
The entire family have remained close since Andrew and Sarah's divorce, and they are often spotted at royal occasions together, including Trooping the Colour celebrations for the Queen's official birthday.
Despite their obvious friendship, the couple have refused to comment on the possibility of them remarrying, however Sarah said last year: “This is our fairytale and we are telling it our way."