Could you provide more details about your configuration, like
– Does the problem arise in connections to physical display or to a virtual desktop?
– What are the desktop environments in use on client and server (Gnome, KDE, etc)? What are the Linux versions in use?
– How is the Ctrl/CapsLock configured (xmodmap, Gnome keyboard settings, etc)? Is it done on client or server (or both)?