A group of Linfox workers in Victoria has lost a challenge to a Fair Work Commission ruling that found in favor of the transport giant in a dispute over the scope of their jobs.