ssh隧道到運行在集羣計算節點上的服務器

Question

我有一個腳本來啓動運行在集羣特定節點上的Jupyter Notebook服務器，並且需要能夠從本地Windows機器（瀏覽器界面）訪問運行實例。 ssh命令是通過paramiko處理的，我想要創建隧道的類似pythonic方式，而不僅僅是系統調用。我嘗試了sshtunnel，不幸的是，這是我目前的絆腳石。

我需要創建兩個隧道，如下所述。爲了清楚起見，HOME是Windows機器，HOST是羣集頭節點，NODE是服務器運行的特定節點。

服務器被綁定到本地主機，默認情況下在端口8888母國和東道國下方的端口是任意的，我只是用它們來說明（在現實中，最便捷的母港也是8888）

[HOME] <------> [HOST] <------> [NODE] 
1111   2222   8888 

我知道下面的代碼是不完整的，只是顯而易見的錯誤，因爲我無法弄清楚如何正確組合本地/遠程綁定。現在我不知道我是否在咆哮錯誤的樹 - 文檔表明我可以一次創建兩個隧道，但是我需要兩個單獨的實例嗎？

from sshtunnel import SSHTunnelForwarder 

t1 = SSHTunnelForwarder(
    ('headnode.server', 22), 
    ssh_username='meagain', 
    ssh_pkey='~/.ssh/id_rsa', 
    local_bind_address = ('localhost',1111), 
    remote_bind_addresses =[ ('localhost',2222), ('compute.node',8888)]) 
t1.start() 

編輯：嘗試選項2，如下所述。使用SSH客戶端，配置設置並在命令行上正常工作。作爲參考，這是阿納康達下用蟒3.6，Windows 7的機器（因此附加文件路徑的下方爭論）

print(sshtunnel.__version__) 
'0.1.0' 
print(paramiko.__version__) 
'2.1.2' 



t1 = sshtunnel.SSHTunnelForwarder(
    NODE, 
    ssh_username=USER, 
    ssh_pkey=paramiko.RSAKey.from_private_key_file(os.path.expanduser(os.path.normpath('~/.ssh/id_rsa'))), 
    ssh_proxy_enabled=True, # DEFAULT 
    ssh_config_file=os.path.expanduser(os.path.normpath('~/.ssh/config')), # if rather than default 
    local_bind_address=('localhost', 1111), 
    remote_bind_address=('localhost', 8889) 
) 
t1.start() 

日誌上：

2017-04-06 12:28:25,523| INF | MainThrea/0981@sshtunnel | 0 keys loaded from agent 
    t1.start() 
    File "D:\Anaconda3\lib\site-packages\sshtunnel.py", line 1224, in start 
    reason='Could not establish session to SSH gateway') 
    File "D:\Anaconda3\lib\site-packages\sshtunnel.py", line 1036, in _raise 
    raise exception(reason) 
sshtunnel.BaseSSHTunnelForwarderError: Could not establish session to SSH gateway 
>>> 2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | paramiko.ssh_exception.ProxyCommandFailure: ('ssh HOST -W NODE:22', 'An operation was attempted on something that is not a socket') 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | 
2017-04-06 12:28:25,538| ERR | MainThrea/1076@sshtunnel | Could not connect to gateway NODE:22 : ssh HOST -W NODE:22 
Traceback (most recent call last): 
    File "D:\Bioinformatics\Scripts\bsub_jupyter\tunneller.py", line 234, in <module> 
2017-04-06 12:28:25,523| INF | MainThrea/0901@sshtunnel | Connecting to gateway: NODE:22 as user 'USER' 
2017-04-06 12:28:25,523| DEB | MainThrea/0904@sshtunnel | Concurrent connections allowed: True 
2017-04-06 12:28:25,523| DEB | MainThrea/1284@sshtunnel | Trying to log in with key: b'1e44a013d97d417e4900025c6c11d073' 
2017-04-06 12:28:25,523| DEB | MainThrea/1047@sshtunnel | Connecting via proxy: 'HOST' 
2017-04-06 12:28:25,523| ERR | Thread-2/1572@transport | Exception: ('ssh HOST -W NODE:22', 'An operation was attempted on something that is not a socket') 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | Traceback (most recent call last): 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | File "D:\Anaconda3\lib\site-packages\paramiko\proxy.py", line 96, in recv 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport |  [self.process.stdout], [], [], select_timeout) 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | OSError: [WinError 10038] An operation was attempted on something that is not a socket 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | During handling of the above exception, another exception occurred: 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | Traceback (most recent call last): 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | File "D:\Anaconda3\lib\site-packages\paramiko\transport.py", line 1749, in run 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport |  self._check_banner() 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | File "D:\Anaconda3\lib\site-packages\paramiko\transport.py", line 1893, in _check_banner 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport |  buf = self.packetizer.readline(timeout) 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | File "D:\Anaconda3\lib\site-packages\paramiko\packet.py", line 331, in readline 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport |  buf += self._read_timeout(timeout) 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | File "D:\Anaconda3\lib\site-packages\paramiko\packet.py", line 485, in _read_timeout 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport |  x = self.__socket.recv(128) 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport | File "D:\Anaconda3\lib\site-packages\paramiko\proxy.py", line 107, in recv 
2017-04-06 12:28:25,538| ERR | Thread-2/1570@transport |  raise ProxyCommandFailure(' '.join(self.cmd), e.strerror) 

Answer 1

由於端口8888被綁定到localhost作爲你提到，它不會從HOST到達。如果是這樣的話，你有兩個選擇：

選項A

使用sshtunnel的ssh_proxy參數：

proxy = paramiko.ProxyCommand('ssh HOST -l USER -i IDENTITY_FILE -W headnode.server:22') 
t1 = SSHTunnelForwarder(
    (NODE, 22), 
    ssh_username='meagain', 
    ssh_pkey='~/.ssh/id_rsa', 
    ssh_proxy=proxy, 
    local_bind_address=('localhost', 1111), 
    remote_bind_addresses=('localhost', 8888) 
) 

選項B

使用ssh配置文件。

你需要有一個ProxyCommand條目的有效配置文件NODE如：

Host HOST 
    User HOSTUSER 
    IdentityFile HOSTUSER_PKEY 
Host NODE 
    ProxyCommand ssh HOST -W %h:%p 

然後，打開通道，讓它讀ProxyCommand項：

t1 = SSHTunnelForwarder(
    (NODE, 22), 
    ssh_username='meagain', 
    ssh_pkey='~/.ssh/id_rsa', 
    ssh_proxy_enabled=True, # DEFAULT 
    ssh_config_file='/path/to/your-config-file', # if rather than default 
    local_bind_address=('localhost', 1111), 
    remote_bind_addresses=('localhost', 8888) 
)