The royal couple have also reportedly received backlash from British tabloids, who have shunned Harry and Meghan for deciding to keep the birth private, and they are eager to escape the criticism.
"Harry and Meghan are seriously considering a life away from the royal family," a palace source tells New Idea.
"There are fears that they could flee to the US with the baby - and there are serious crisis talks happening behind palace walls about it.
“The truth is, Meghan wants to go back and Harry just wants to make her happy. She misses acting and Harry thinks he can continue his philanthropic work in the US and has even been talking to Oprah about working together,” the insider added.
Last week, Oprah announced that she would be working with Harry on a series for Apple TV and that they have had several meetings in London with the crew to discuss the show.
According to E! online, Oprah said: “I want everybody to know that, first of all, I don’t do or engage in anything unless I’m giving 100 per cent. He feels
the same. And so he is a great partner in helping us decide who we're going to interview."
Harry is also said to be furious with the way the British press have treated him.
Last week, Arthur Edwards, a photographer for The Sun, slammed the couple's decision to keep details of the birth a secret.
“I photographed Harry when he came out in Diana’s arms, and I would like to have photographed him when he came out with his own baby.
"It’s a joyful occasion, with betting companies coming around with names on a board, it’s a rather big event,” Arthur said.
Another tradition the Sussexes will be shunning is giving their child a royal title.
Watch the video below to find out why!
Speaking more about the prince’s decision, he admitted: “It’s the way Harry is at the moment, he’s just got this bee in his bonnet that all the media are to be ignored. Harry used to be the best of all of them. We’d get together in a pub and we’d talk about everything, get it off our plate.
"It would be frank and open, and you never reported it. Now, it's not even 'good morning', nothing."
But it's not just the stress from the press that is causing the royal couple to consider the move to Tinseltown.
“Harry and Meghan have had such a tumultuous year – their wedding and falling pregnant were real high points, but all the fights with William and Kate and the dramas with staff – it’s really affected their marriage and they just want to get as far away from the palace as possible,” the source reveals.
Harry knows he will never be king, so he doesn’t have the same pressures as William, and would be free to make the move.
“He feels that they can spend the first few years of the baby’s life in the US and have a break, and then come back to royal life if they want,’ the source added.
“But at this point, he doesn’t see that happening. He and Meghan are pretty committed to moving away from the royal family.”
Meghan has never shied away from her American roots, and with her mum living in LA and the former actress said to be missing life in front of the camera, could she be eager to raise her child in Hollywood?
As news emerged that Meghan is also set on hiring an American nanny for the baby, it’s another sign that her heart is still in her homeland.
The Mirror reported that the Duke and Duchess of Sussex are even considering a male aid.
A source said: “Meghan and Harry have clear ideas on how to bring up their children. Meghan was clear in telling recruiters she favours an American over a Brit.
"That is important to her, she’s never hidden the fact she is fiercely proud of her American roots.”
For more, pick up the latest copy of New Idea on sale now!