Chalmers accuses government of abandoning Victorians in ‘hour of need’