Just to clarify:
The remembered column position is updated when a left/right cursor movement is done on a line.
EDIT: It should also be updated when the cursor is moved by clicking with the mouse cursor.
Thanks for your inputs. I might consider that in future.