The publishers of The Australian and Al Jazeera have failed to persuade a judge to hold a preliminary hearing on the question of whether the nephew of the former prime minister of Cambodia suffered serious harm as a result of publications he says painted him as a criminal.