加載JSON數組豬

我有以下格式加載JSON數組豬

[ 
    { 
    "id": 2, 
    "createdBy": 0, 
    "status": 0, 
    "utcTime": "Oct 14, 2014 4:49:47 PM", 
    "placeName": "21/F, Cunningham Main Rd, Sampangi Rama NagarBengaluruKarnatakaIndia", 
    "longitude": 77.5983817, 
    "latitude": 12.9832418, 
    "createdDate": "Sep 16, 2014 2:59:03 PM", 
    "accuracy": 5, 
    "loginType": 1, 
    "mobileNo": "0000005567" 
    }, 
    { 
    "id": 4, 
    "createdBy": 0, 
    "status": 0, 
    "utcTime": "Oct 14, 2014 4:52:48 PM", 
    "placeName": "21/F, Cunningham Main Rd, Sampangi Rama NagarBengaluruKarnatakaIndia", 
    "longitude": 77.5983817, 
    "latitude": 12.9832418, 
    "createdDate": "Oct 8, 2014 5:24:42 PM", 
    "accuracy": 5, 
    "loginType": 1, 
    "mobileNo": "0000005566" 
    } 
]

json文件，當我嘗試使用JsonLoader類我越來越喜歡意外的結束輸入的，一個錯誤的數據加載到豬：預期適合對象

a = LOAD '/user/root/jsoneg/exp.json' USING JsonLoader('id:int,createdBy:int,status:int,utcTime:chararray,placeName:chararray,longitude:double,latitude:double,createdDate:chararray,accuracy:double,loginType:double,mobileNo:chararray'); 
b = foreach a generate $0,$1,$2; 
dump b;

來源

2014-11-03 Anas A

是您的JSON文件格式有一個JSON對象在單線上？我認爲豬正試圖逐行解析json，而json被分成多行。 – mbaxi 2014-11-03 10:18:18

我也面臨類似的問題的某個時候回來，接近標記後來我才知道，豬八戒JSON將不支持多JSON格式。它總會期望json輸入必須在單行中。

而不是原生的Jsonloader，我建議你使用elephantbird json loader。這對於Jsons格式非常有用。

您可以從下面的鏈接

http://www.java2s.com/Code/Jar/e/elephant.htm

下載的罐子我改變了你的輸入格式，以單行和加載通過elephantbird如下

input.json 
{"test":[{"id": 2,"createdBy": 0,"status": 0,"utcTime": "Oct 14, 2014 4:49:47 PM","placeName": "21/F, Cunningham Main Rd, Sampangi Rama NagarBengaluruKarnatakaIndia","longitude": 77.5983817,"latitude": 12.9832418,"createdDate": "Sep 16, 2014 2:59:03 PM","accuracy": 5,"loginType": 1,"mobileNo": "0000005567"},{"id": 4,"createdBy": 0,"status": 0,"utcTime": "Oct 14, 2014 4:52:48 PM","placeName": "21/F, Cunningham Main Rd, Sampangi Rama NagarBengaluruKarnatakaIndia","longitude": 77.5983817,"latitude": 12.9832418,"createdDate": "Oct 8, 2014 5:24:42 PM","accuracy": 5,"loginType": 1,"mobileNo": "0000005566"}]} 

PigScript: 
REGISTER '/tmp/elephant-bird-hadoop-compat-4.1.jar'; 
REGISTER '/tmp/elephant-bird-pig-4.1.jar'; 

A = LOAD 'input.json ' USING com.twitter.elephantbird.pig.load.JsonLoader('-nestedLoad'); 
B = FOREACH A GENERATE FLATTEN($0#'test'); 
C = FOREACH B GENERATE FLATTEN($0) AS mymap; 
D = FOREACH C GENERATE mymap#'id',mymap#'placeName',mymap#'status'; 
DUMP D; 

Output: 
(2,21/F, Cunningham Main Rd, Sampangi Rama NagarBengaluruKarnatakaIndia,0) 
(4,21/F, Cunningham Main Rd, Sampangi Rama NagarBengaluruKarnatakaIndia,0)

來源

2014-11-03 10:35:58

感謝您的代碼。節省了很多時間 – Astro 2016-04-08 19:08:54

加載JSON數組豬

回答

相關問題