7777777

[7777777]

I have restarted the nxserver (i.e. service nxserver restart). Now, I am able to login to the Linux server again using NoMachine. I did save the /usr/NX/var/log content.

[7777777]

Hello Britgirl,

Windows A is Windows 10 (when I work from home) or Windows 7 (when I work from another office).

Yes, you are right: when I connect from B to C (this is setup 1), the performance is fast.

Unfortunately, I can not test what happens when I connect from A to B with NoMachine since there is no direct connection to the company computers from the outside world. We have to go through a specific web-site, use RSA token to go through 1st level authentication, which then downloads and launches some software, which in turn starts WRD and then go through 2nd level authentication.

So, you are saying there is nothing I can do to improve performance of NoMachine in setup 2?

Thank you!

[7777777]

Hi haven,

It might take me some time to collect debug logs since I use NoMachine at work and restarting the server would mean killing running applications, which I would do if there is no other way to solve the frozen NoMachine problem. But if/when it happens again, I will be happy to help.

I use “Red Hat Enterprise Linux Server release 7.4 (Maipo)” in the virtual machine (this is what ‘cat /etc/redhat-release’ gives). It is an about 1 year old distribution: https://access.redhat.com/articles/3078 But there were security updates installed on top of the base distribution (including those to mitigate Spectre/Meltdown vulnerabilities and others). Kernel version is 3.10.0-693.17.1.el7.x86_64 (‘uname -r’).

As I wrote above, the problem might be related to mutiprocessing plotting with python matplotlib. Both times the freezes happened, I was doing that. You could try the following two pieces (paste/copy) of Python code to reproduce it:

# input data
import pandas as pd, matplotlib.pyplot as plt
df = pd.DataFrame(data={'i':['A','A','B','B'],
'x':[1.,2.,3.,4.],
'y':[1.,2.,3.,4.]})
df.set_index('i', inplace=True)
df.sort_index(inplace=True)

# function which creates a figure from the data
def Draw(df, i):
fig = plt.figure(i)
ax = fig.gca()
df = df.loc[i,:]
ax.scatter(df[‘x’], df[‘y’])
return fig

def DrawWrapper(x): return Draw(*x)

# creating figures in parallel
from multiprocessing import Pool
poolSize = 2
with Pool(poolSize) as p:
args = [(df,‘A’), (df,‘B’)]
figs = p.map(DrawWrapper, args)

# attempt to visualize the results
fig = plt.figure(‘A’)
plt.show()
# FIXME: get “RuntimeError: main thread is not in main loop”

and this

# input data
import pandas as pd, matplotlib.pyplot as plt
df = pd.DataFrame(data={'i':['A','A','B','B'],
'x':[1.,2.,3.,4.],
'y':[1.,2.,3.,4.]})
df.set_index('i', inplace=True)
df.sort_index(inplace=True)

# function which creates a figure from the data
def Draw(df, i):
fig = plt.figure(i)
ax = fig.gca()
df = df.loc[i,:]
ax.scatter(df[‘x’], df[‘y’])
plt.show()

# creating figures in parallel
from multiprocessing import Process
args = [(df,‘A’), (df,‘B’)]
for a in args:
p = Process(target=Draw, args=a)
p.start()

# FIXME: run this piece after you run the 1st code pieces above
# result is the same (might be even worse since I do not
# get any result which I could attempt to show):
# …
# RuntimeError: main thread is not in main loop
# RuntimeError: main thread is not in main loop

Especially, try to cancel the running commands by repeatedly pressing Ctrl+C. I believe this is exactly what I did when the freezes happened (the code was more complex, but the relevant parts were the same). Or if you have some sandbox machine on which I could do it, I can help to attempt to reproduce the problem.

[7777777]

Hello haven,

I connect to a virtual machine Linux, but if it is more reliable, I could connect to a physical server instead.

I will send the node directory in a few seconds to the e-mail address.

Thank you for your help!

[7777777]

Below is the corresponding section of the nxserver.log. The problem happened 2 times yesterday. Each time the solution was to kill the nxnode.bin process and then I was able to login again by creating a new session. It might be somehow caused by mutiprocessing plotting with python matplotlib. Both times the freeze happened, I was doing that.

2018-07-12 10:29:27 858.909 2388042 NXSERVER User ‘myuser’ logged in from ‘AAA.BBB.CCC.DDD’ using authentication method password.

2018-07-13 10:17:24 329.396 747572 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec /usr/NX/scripts/restricted/nxupdate.sh abbipub background check’ with pid ‘2825183/2825183’ finished with exit code 110 after 90,629 seconds.

2018-07-15 10:17:40 015.121 747572 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec /usr/NX/scripts/restricted/nxupdate.sh abbipub background check’ with pid ‘3725972/3725972’ finished with exit code 110 after 91,225 seconds.

2018-07-17 10:17:57 018.808 747572 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec /usr/NX/scripts/restricted/nxupdate.sh abbipub background check’ with pid ‘419205/419205’ finished with exit code 110 after 90,609 seconds.

2018-07-18 10:42:38 880.964 869208 NXSERVER User ‘myuser’ logged in from ‘AAA.BBB.CCC.DDD’ using authentication method password.

2018-07-18 10:42:44 247.206 869208 NXSERVER WARNING! Session 24C3934C79F03054F1ED0198336CAA48 reached timeout during termination.

2018-07-18 10:42:44 248.430 869208 NXSERVER WARNING! Killing session 24C3934C79F03054F1ED0198336CAA48 nxnode with PID 2388065.

2018-07-18 10:42:44 372.414 2388042 NXSERVER WARNING! Connection to the 24C3934C79F03054F1ED0198336CAA48 nxnode closed unexpectedly.

2018-07-18 10:42:44 435.893 869208 NXSERVER WARNING! Session 24C3934C79F03054F1ED0198336CAA48 server with PID 2388042 has been killed.

2018-07-18 10:43:19 995.016 869396 NXSERVER User ‘myuser’ logged in from ‘AAA.BBB.CCC.DDD’ using authentication method password.

2018-07-18 10:43:25 239.512 869396 NXSERVER WARNING! Session 960784948E1967BABD7EDFAFD82CA749 reached timeout during termination.

2018-07-18 10:43:25 240.716 869396 NXSERVER WARNING! Killing session 960784948E1967BABD7EDFAFD82CA749 nxnode with PID 869268.

2018-07-18 10:43:25 521.480 869208 NXSERVER WARNING! Connection to the 960784948E1967BABD7EDFAFD82CA749 nxnode closed unexpectedly.

2018-07-18 10:43:25 536.241 869208 NXSERVER ERROR! Status ‘Failed’ for ‘started’ session with Id: ‘960784948E1967BABD7EDFAFD82CA749’

2018-07-18 10:43:25 650.791 869208 NXSERVER User ‘myuser’ from ‘AAA.BBB.CCC.DDD’ logged out.

2018-07-18 10:43:25 651.642 869208 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec –node –user myuser –priority realtime –mode 0 –pid 15 -H 5’ with pid ‘869261/869261’ finished with exit code 9 after 39,905 seconds.

2018-07-18 10:43:25 651.756 869208 NXSERVER WARNING! NXExec process 869261 finished abnormally with exit code 9.

2018-07-18 10:43:25 804.629 869396 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec nxkill.sh 869261 9 ‘ with pid ‘869557/869557’ finished with exit code 1 after 0,259 seconds.

2018-07-18 10:43:25 831.781 869396 NXSERVER WARNING! Session 960784948E1967BABD7EDFAFD82CA749 server with PID 869208 has been killed.

2018-07-18 10:43:26 459.336 869658 NXNODE WARNING! Cannot write to FD#1.

2018-07-18 10:43:26 459.449 869658 NXNODE WARNING! Error is: 32, ‘Broken pipe’.

2018-07-18 10:43:26 459.548 869658 NXNODE ERROR! Failed to send message: NX> 1000 NoMachine Node – Version 6.2.4: write to FD#1 failed: Broken pipe

2018-07-18 10:43:58 845.532 869916 NXSERVER User ‘myuser’ logged in from ‘AAA.BBB.CCC.DDD’ using authentication method password.

2018-07-18 10:44:04 037.228 869916 NXSERVER WARNING! Session 799256F9BEFC2821F39529D9F719F9E6 reached timeout during termination.

2018-07-18 10:44:04 038.675 869916 NXSERVER WARNING! Killing session 799256F9BEFC2821F39529D9F719F9E6 nxnode with PID 869740.

2018-07-18 10:44:04 090.591 869396 NXSERVER WARNING! Connection to the 799256F9BEFC2821F39529D9F719F9E6 nxnode closed unexpectedly.

2018-07-18 10:44:04 121.412 869396 NXSERVER ERROR! Status ‘Failed’ for ‘started’ session with Id: ‘799256F9BEFC2821F39529D9F719F9E6’

2018-07-18 10:44:04 146.607 869396 NXSERVER User ‘myuser’ from ‘AAA.BBB.CCC.DDD’ logged out.

2018-07-18 10:44:04 147.447 869396 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec –node –user myuser –priority realtime –mode 0 –pid 16 -H 5’ with pid ‘869688/869688’ finished with exit code 9 after 38,062 seconds.

2018-07-18 10:44:04 147.583 869396 NXSERVER WARNING! NXExec process 869688 finished abnormally with exit code 9.

2018-07-18 10:44:04 175.569 869916 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec nxkill.sh 869688 9 ‘ with pid ‘869949/869949’ finished with exit code 1 after 0,090 seconds.

2018-07-18 10:44:04 189.393 869916 NXSERVER WARNING! Session 799256F9BEFC2821F39529D9F719F9E6 server with PID 869396 has been killed.

2018-07-18 10:44:05 349.451 869973 NXNODE WARNING! Cannot write to FD#1.

2018-07-18 10:44:05 349.586 869973 NXNODE WARNING! Error is: 32, ‘Broken pipe’.

2018-07-18 10:44:05 349.675 869973 NXNODE ERROR! Failed to send message: NX> 1000 NoMachine Node – Version 6.2.4: write to FD#1 failed: Broken pipe

2018-07-18 10:44:37 314.630 870367 NXSERVER User ‘myuser’ logged in from ‘AAA.BBB.CCC.DDD’ using authentication method password.

2018-07-18 10:44:42 540.904 870367 NXSERVER WARNING! Session 3959479F1CB5AC18ED88C738520D864F reached timeout during termination.

2018-07-18 10:44:42 542.619 870367 NXSERVER WARNING! Killing session 3959479F1CB5AC18ED88C738520D864F nxnode with PID 870004.

2018-07-18 10:44:42 590.532 869916 NXSERVER WARNING! Connection to the 3959479F1CB5AC18ED88C738520D864F nxnode closed unexpectedly.

2018-07-18 10:44:42 615.176 869916 NXSERVER ERROR! Status ‘Failed’ for ‘started’ session with Id: ‘3959479F1CB5AC18ED88C738520D864F’

2018-07-18 10:44:42 664.803 870367 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec nxkill.sh 869984 9 ‘ with pid ‘870399/870399’ finished with exit code 1 after 0,073 seconds.

2018-07-18 10:44:42 679.722 869916 NXSERVER User ‘myuser’ from ‘AAA.BBB.CCC.DDD’ logged out.

2018-07-18 10:44:42 680.838 869916 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec –node –user myuser –priority realtime –mode 0 –pid 16 -H 5’ with pid ‘869984/869984’ finished with exit code 9 after 38,356 seconds.

2018-07-18 10:44:42 680.994 869916 NXSERVER WARNING! NXExec process 869984 finished abnormally with exit code 9.

2018-07-18 10:44:42 690.268 870367 NXSERVER WARNING! Session 3959479F1CB5AC18ED88C738520D864F server with PID 869916 has been killed.

2018-07-18 10:44:43 393.819 870424 NXNODE WARNING! Cannot write to FD#1.

2018-07-18 10:44:43 393.930 870424 NXNODE WARNING! Error is: 32, ‘Broken pipe’.

2018-07-18 10:44:43 394.030 870424 NXNODE ERROR! Failed to send message: NX> 1000 NoMachine Node – Version 6.2.4: write to FD#1 failed: Broken pipe

2018-07-18 10:45:15 667.082 870696 NXSERVER User ‘myuser’ logged in from ‘AAA.BBB.CCC.DDD’ using authentication method password.

2018-07-18 10:45:20 843.809 870696 NXSERVER WARNING! Session 1B89660A25493C78E6EB2EBA51DF2871 reached timeout during termination.

2018-07-18 10:45:20 845.016 870696 NXSERVER WARNING! Killing session 1B89660A25493C78E6EB2EBA51DF2871 nxnode with PID 870466.

2018-07-18 10:45:20 888.091 870367 NXSERVER WARNING! Connection to the 1B89660A25493C78E6EB2EBA51DF2871 nxnode closed unexpectedly.

2018-07-18 10:45:20 908.204 870367 NXSERVER ERROR! Status ‘Failed’ for ‘started’ session with Id: ‘1B89660A25493C78E6EB2EBA51DF2871’

2018-07-18 10:45:20 925.091 870367 NXSERVER User ‘myuser’ from ‘AAA.BBB.CCC.DDD’ logged out.

2018-07-18 10:45:20 925.895 870367 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec –node –user myuser –priority realtime –mode 0 –pid 16 -H 5’ with pid ‘870425/870425’ finished with exit code 9 after 38,117 seconds.

2018-07-18 10:45:20 926.014 870367 NXSERVER WARNING! NXExec process 870425 finished abnormally with exit code 9.

2018-07-18 10:45:20 964.980 870696 NXSERVER WARNING! Process ‘/usr/NX/bin/nxexec nxkill.sh 870425 9 ‘ with pid ‘870728/870728’ finished with exit code 1 after 0,076 seconds.

2018-07-18 10:45:20 979.002 870696 NXSERVER WARNING! Session 1B89660A25493C78E6EB2EBA51DF2871 server with PID 870367 has been killed.

2018-07-18 10:45:21 687.710 870760 NXNODE WARNING! Cannot write to FD#1.

2018-07-18 10:45:21 687.822 870760 NXNODE WARNING! Error is: 32, ‘Broken pipe’.

2018-07-18 10:45:21 687.908 870760 NXNODE ERROR! Failed to send message: NX> 1000 NoMachine Node – Version 6.2.4: write to FD#1 failed: Broken pipe

[Author]

Posts