Thank you for pointing out the fact that the latency was too high.
Since I messed with my laptop’s NIC parameters recently I decided to revert the changes to default and everything is perfectly smooth now.
I don’t know which parameter did the trick (I had disabled most of Offloading and Packet priority) but it works great now.
Thanks a lot !