The royal later took to Instagram to praise the England rugby team for an 'outstanding job'.
'Tonight was not England's night,' the Duke said on the Sussex Royal Instagram account.
'But the whole nation is incredibly proud of what @EnglandRugby have achieved over the past few months,' he added.
'Hold your heads high boys, you did an outstanding job and we couldn't have asked more from you.'
Harry watched his team's efforts sitting in the grandstand alongside Japan's Fumihito, Crown Prince Akishino and Kiko, Crown Princess Akishino.
Harry was seen giving South African President Cyril Ramaphosa a hug in a sweet moment that was documented on the royals Instagram account.
The Duke, who wore a red poppy during the match, will return to the U.K. on Sunday in preparation for Remembrance Week.
WATCH: Prince Harry adorable moment caught on camera