Court documents obtained by news.com.au allege Paul Frost convinced a boy to pull down his shorts and masturbate in front of him.
The documents also claim Paul Frost committed sexual intercourse without consent.
His lawyer, Sebastian De Brennan, questioned in court the timing of the 11 alleged victims coming forward to police.
"The corroborating of all this, why have these individuals come forward now? What is striking about this is that they were all part of the swim class," he said.
"And the possibility of concoction or contamination."
But the police prosecutor said the alleged victims were adults now and were unlikely to have been in contact with each other.
The accused's wife, Ivana Frost, who is a national food manager for IKEA, provided written testimony stating she was in "shock and utter disbelief" at the charges against her "loving and caring husband".
She said their 10-year-old son and 14-year-old daughter had been left traumatised after their father was arrested "in front of them as they were getting ready to leave for school".
She also expressed concern about her husband's "very gentle personality" making him "extremely vulnerable in the prison environment".
Magistrate Chris McRobert granted strict conditional bail, saying keeping Paul in custody for what would likely be over a year before trial would "effectively ruin his family".
He will next appear at Bankstown Court on October 9.