當--where子句的列名帶空格時，Apache Sqoop導入失敗

當--where子句的列名帶有空格時遇到sqoop import命令時出現問題。數據庫是MySQL。當--where子句的列名帶空格時，Apache Sqoop導入失敗

MySQL表

create table testsqoop(`x t` integer); 

insert into testsqoop values(1); 
insert into testsqoop values(2); 
insert into testsqoop values(3); 
insert into testsqoop values(4); 
insert into testsqoop values(5); 

select * from testsqoop where `x t` > 2; 
+------+ 
| x t | 
+------+ 
| 3 | 
| 4 | 
| 5 | 
+------+ 
3 rows in set (0.00 sec)

Sqoop命令

sqoop import --connect 'jdbc:mysql://127.0.0.1:3306/mytestdb?zeroDateTimeBehavior=convertToNull&?user=test&password=test' --username test --password test --driver com.mysql.jdbc.Driver --table testsqoop --target-dir /user/tmp/testsqoop -m 1 --hive-import --hive-overwrite --hive-table default.test --hive-delims-replacement ' ' --outdir /tmp/ --direct --where "`x t` > 2"

錯誤

Error: java.io.IOException: SQLException in nextKeyValue 
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277) 
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556) 
at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) 
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) 
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) 
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) 
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) 
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) 
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) 
at java.security.AccessController.doPrivileged(Native Method) 
at javax.security.auth.Subject.doAs(Subject.java:422) 
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '> 2) AND (1=1) AND (1=1)' at line 1 
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) 
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 
at java.lang.reflect.Constructor.newInstance(Constructor.java:422) 
at com.mysql.jdbc.Util.handleNewInstance(Util.java:406) 
at com.mysql.jdbc.Util.getInstance(Util.java:381) 
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1030) 
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956) 
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3491) 
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3423) 
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936) 
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060) 
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2542) 
at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1734) 
at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1885) 
at org.apache.sqoop.mapreduce.db.DBRecordReader.executeQuery(DBRecordReader.java:111) 
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:235) 
... 12 more

這些似乎都不工作 - --where 「x t> 2」 --where 「」 XT」> 2" --where 「 'XT'> 2」

來源

2016-11-12 Suchitra Ramani

使用方括號[]嘗試：

其中[ xt]> 2

來源

2016-11-13 07:09:03 soulzcore

不幸的是，不工作。導致：com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException：您的SQL語法中有錯誤;請檢查與您的MySQL服務器版本相對應的手冊，以便在第1行'[xt]> 2）AND（1 = 1）AND（1 = 1）'附近使用正確的語法。 –

您可以嘗試使用自由格式查詢，而不是 - - 選項。像這樣： – soulzcore

--query'select * from testsqoop where'x t'> 2 where $ CONDITIONS' – soulzcore

當--where子句的列名帶空格時，Apache Sqoop導入失敗

回答

相關問題