如何使用Sqoop將Postgres表格（幾何格式）導入到Hive中？

Question

我在Postgres表與幾何類型data.Now我試圖用Sqoop.Then它給這個錯誤導入的Postgres表到蜂巢，

sqoop import --connect jdbc:postgresql://192.168.1.130:5432/Analyst_Bangalore --username postgres --password track@123 --table state -m 1 --warehouse-dir /user/hive/warehouse/analytics.db 

ERROR orm.ClassWriter (ClassWriter.java:generateFields(560)) - Cannot resolve SQL type 1111 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateEquals(645)) - Cannot resolve SQL type 1111 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateEquals(645)) - Cannot resolve SQL type 1111 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateDbRead(718)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateDbRead(718)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateLoadLargeObjects(798)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateLoadLargeObjects(798)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,115 ERROR orm.ClassWriter (ClassWriter.java:myGenerateDbWrite(884)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,116 ERROR orm.ClassWriter (ClassWriter.java:myGenerateDbWrite(884)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,116 ERROR orm.ClassWriter (ClassWriter.java:myGenerateHadoopRead(955)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,116 ERROR orm.ClassWriter (ClassWriter.java:myGenerateHadoopWrite(1595)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,117 ERROR orm.ClassWriter (ClassWriter.java:myGenerateHadoopWrite(1595)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,117 ERROR orm.ClassWriter (ClassWriter.java:myGenerateToString(1314)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,117 ERROR orm.ClassWriter (ClassWriter.java:myGenerateToString(1314)) - No Java type for SQL type 1111 for column the_geom 
2016-10-20 15:52:30,117 ERROR sqoop.Sqoop (Sqoop.java:runSqoop(181)) - Got exception running Sqoop: java.lang.NullPointerException 
java.lang.NullPointerException 
     at org.apache.sqoop.orm.ClassWriter.parseNullVal(ClassWriter.java:1377) 
     at org.apache.sqoop.orm.ClassWriter.parseColumn(ClassWriter.java:1402) 
     at org.apache.sqoop.orm.ClassWriter.myGenerateParser(ClassWriter.java:1528) 

任何人有任何想法如何幾何數據導入到蜂巢，請建議我。任何意見都表示讚賞。

Answer 1

不支持幾何數據類型，默認爲Sqoop。您需要爲Java手動添加映射（針對POJO類的）。

在代碼中添加這個標籤：

--map-column-java the_geom=String 

最後的命令：

sqoop import \ 
--connect jdbc:postgresql://192.168.1.130:5432/Analyst_Bangalore \ 
--username postgres \ 
--password track@123 \ 
--map-column-java the_geom=String \ 
--table state \ 
-m 1 \ 
--warehouse-dir /user/hive/warehouse/analytics.db 

---

，如果你使用做蜂巢進口添加--map-column-hive the_geom=string。