2012-09-27 81 views
2

我想從SQL Server 2008 R2數據庫導入一個簡單的表到配置單元。sqoop從sql server導入表時掛起

Hadoop version - CDH3U3 
Sqoop version - 1.3.0-cdh3u3 
$SQOOP_HOME/lib - sqljdbc4.jar 
$SQOOP_HOME/lib - sqoop-sqlserver-1.0.jar 
$SQOOP_CONF_DIR/managers.d/mssqoop-sqlserver 

Windows firewall - disabled 
Linux IPTables - disabled 

我的導入命令是 -

sqoop import --connect 'jdbc:sqlserver://172.16.1.47;username=sa;password=asdf1234;database=test' --table bruce --hive-import --verbose 

我沒有看到任何錯誤消息,但它只是掛起,直到永遠。如果我查看SQL Server活動監視器,我可以看到正在創建一個進程。

這裏是sqoop輸出 -

[[email protected] bruce]# ./sqoop_test_sqlserver.sh<br> 
Warning: /usr/lib/hbase does not exist! HBase imports will fail.<br> 
Please set $HBASE_HOME to the root of your HBase installation.<br> 
12/09/27 15:37:58 DEBUG tool.BaseSqoopTool: Enabled debug logging.<br> 
12/09/27 15:37:58 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override<br> 
12/09/27 15:37:58 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Added factory com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory specified by /usr/lib/sqoop/conf/managers.d/mssqoop-sqlserver<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Loaded manager factory: com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory<br> 
12/09/27 15:37:58 INFO SqlServer.MSSQLServerManagerFactory: Using Microsoft's SQL Server - Hadoop Connector<br> 
12/09/27 15:37:58 INFO manager.SqlManager: Using default fetchSize of 1000<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Instantiated ConnManager [email protected]<br> 
12/09/27 15:37:58 INFO tool.CodeGenTool: Beginning code generation<br> 
12/09/27 15:37:58 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection.<br><br> 

任何建議,將不勝感激。

回答

0

看來您正在使用Microsoft SQL Connector for Sqoop。作爲第一步,我會建議關閉它,看看是否有幫助。

1

使用以下命令

sqoop import --connect 'jdbc:sqlserver://172.16.1.47:<port_number>/test --table bruce --username sa --password asdf1234 --hive-import --hive-table <table_in_hive> --verbose 

凡table_in_hive是動態創建