Assuming the idler arm should pivot at the point where it is attached to the frame and that the center link should not ride up and down on the bushing?
Questions like this should be in Technical. But yes, you are correct, it should just swing around and not move up or down.