Rochester residents are angry the Victorian government's "short-sighted" response to flood protection leaves them fending for themselves.