Gillard Loses Support, Says Cassidy