The royal, 33, brushed off comments that he should following in the footsteps of a royal fan in Ireland, and have five children.
Greeting fans in Dublin, Elaine Adam-Stewart, 43, told Harry: 'My husband also has red hair and he gave me five children - when are you and Meghan going to get going?'
Elaine told PEOPLE that the prince saw the humour, 'He laughed and said ‘five children? — too many'.’
Earlier in the day, the Duke and Duchess of Sussex had an adorable run in with an Irish toddler.
Visiting Dublin's Croke Park on Wednesday, the Duchess of Sussex let her hair down after having it up in a sleek bun earlier in the day.
3-year-old Walter Kieran couldn't keep his hands off the royal's long, wavy locks.
The newlywed couple have openly admitted their desire to start a family.
'Of course,' Harry told the BBC following his engagement announcement to Meghan. 'You know, one step at a time. Hopefully we'll start a family in the near future.'
During a visit to Northern Ireland in March, the former Suits star admitted their baby plans when speaking to the couple who own Shnuggle, an innovative baby product company.
'I am sure at one point we will need the whole thing,' Meghan told the couple. 'It’s very sweet.'
This week's New Idea Royals podcast delves into what REALLY happened at Prince Louis' royal christening.