There was a bug related to missing haproxy config files:
/etc/promenade/haproxy/haproxy.cfg
/etc/kubernetes/manifests/haproxy.yaml
Those files are initially generated with static pods and
after that it periodically updated by haproxy-anchor.
Most plausible reason why it could be missed is haproxy-anchor cleaned
it up while terminating. To solve the issue there were restored manually.
This patch tries to make such a situation clearer by two things:
1) it leaves a message in a cleanup file that haproxy-anchor was
terminated and the cleaup happened.
2) instead of removing files it moves them to backup dir from that
they could be restored easily.
Change-Id: Ia1449d188c15b71dd756e96b1ea2d4a672011a17
44a0c200f2