用於格式化管道輸出的bash腳本

好的，你問了它 - 這是我正在嘗試使用的整個代碼。用於格式化管道輸出的bash腳本

我需要的幫助是這樣的： postprocauto.sh：以良好的可讀格式呈現數據的腳本。

我應該採取autocsv文件的貓（下面的示例 - 完整的文件是160K），然後把它管道其他各種腳本，以便在最後，你都會有這樣的命令行：

cat autocsv | ./ prepprocauto.sh | ./BMW.sh | ./6cyl.sh | ./hwyfe.sh | ./postprocauto.sh

我的問題是，除了postprocauto.ch之外，我可以讓所有的東西都可以運行。我需要能夠做到這一點：

Requirements for this script: 
It must print header information after 20 lines of data. 

The breaks must have a least one empty line between them 
before printing another header. 

The last line of the output should print out the number of 
records that were processed.

輸出的一個例子：

Year Eng. Disp. Cyl. City FE Hwy FE Model 
2013 1.5 4  39 38  ILX 
2013 2 4 24 35  ILX 
2013 2.4 4  22 31  ILX 
2013 2.4 4  22 31  TSX 
2013 2.4 4  21 29  TSX 
2013 3.5 6  19 28  TSX 
2013 1.3 4  41 44  INSIGHT 
2013 1.3 4  41 44  INSIGHT 
2013 3.5 6  20 29  TL 2WD 
2013 3.7 6  18 26  TL 4WD 
2013 3.7 6  17 25  TL 4WD 
There were 11 records processed.

不同的腳本如下 - 如果你想全尺寸autocsv，告訴我把它放在哪裏 - 520K文件大小

prepprocauto.sh

#!/bin/bash 

while read x 
do 
    echo $x | awk -F',' ' { print $1":"$2":"$4":"$7":"$8":"$10":"$11":"$12":"$22":"$24}' 

done

BMW.sh

#!/bin/bash 

selection='BMW' 

if [ ! $# -lt 1 ]; then 
    selection=$1 
fi 


while read y; do 

    model=$(echo $y | awk -F':' '{print $2 }') 

    if [ "$model" == "$selection" ]; then 
      echo $y 
    fi 
done

6cyl.sh

#!/bin/bash 

selection='6' 

if [ ! $# -lt 1 ]; then 
    selection=$1 
fi 


while read y; do 

    model=$(echo $y | awk -F':' '{print $5 }') 

    if [ "$model" == "$selection" ]; then 
      echo $y 
    fi 
done

hwyfe.sh

#!/bin/bash 

selection='31' 

if [ ! $# -lt 1 ]; then 
    selection=$1 
fi 


while read y; do 

    hwy=$(echo $y | awk -F':' '{print $7 }') 

    if [ "$hwy" -gt "$selection" ]; then 
      echo $y 
    fi 
done

postprocauto.sh

output=$(awk -F ':' '{print $1 "\t" $4 "\t"$5"\t" $6 "\t" $7 "\t" $3}') 
echo "Year Eng. Disp Cyl City FE Hwy FE Model" 
echo "$output"

的autocsv文件的內容（減少很多）

2013,Audi,Audi,TT Roadster quattro,ADX,67,2,4,Auto(AM-S6),22,31,26,28.4068,42.25 
79,33.3217,22.407,31.1674,25.6515,,TC,Turbocharged,AMS,Automated Manual- Selecta 
ble (e.g. Automated Manual with paddles),6,Y,N,A,10,GP,Gasoline (Premium Unleade 
d Recommended),MPG,N,,,,,,,2200,2200,2,2,1,Two Seaters,car,Vehicle Specific 5-cy 
cle label,6/18/12,12113,,N,N,,,N,N,ENGINE CODE CDMA ONLY.,N,,Y,CONTINUOUS VARIAB 
LE VALVE TIMING,N,,,,,,,,,,,,,,,,,,,,,,,,,,,GDI,Spark Ignition Direct Injection, 
N,N,5W40,33.3,7,7,,DADXV02.03UA,5,600, 
2013,BMW,BMW,Z4 sDrive28i,BMX,428,2,4,Auto(A8),22,33,26,27.9499,46.8923,34.1594, 
21.9803,33.2305,25.9308,,TC,Turbocharged,A,Automatic,8,Y,N,R,10,GP,Gasoline (Pre 
mium Unleaded Recommended),MPG,N,,,,,,,2200,2200,2,2,1,Two Seaters,car,Derived 5 
-cycle label,7/24/12,11033,,N,N,,,N,N,,N,,Y,variable valve timing at inlet and o 
utlet valves,Y,variable valve lift at inlet valves,,,,,,,,,,,,,,,,,,,,,,,,,,GDI, 
Spark Ignition Direct Injection,,Y,0W30,34.3,7,7,,DBMXJ02.0N20,5,600, 
2013,BMW,BMW,Z4 sDrive28i,BMX,429,2,4,Manual(M6),22,34,26,28.3664,48.0364,34.774 
1,22.2841,34.0033,26.3746,,TC,Turbocharged,M,Manual,6,N,N,R,10,GP,Gasoline (Prem 
ium Unleaded Recommended),MPG,N,,,,,,,2200,2200,2,2,1,Two Seaters,car,Derived 5- 
cycle label,7/25/12,11092,,N,N,,,N,N,,N,,Y,variable valve timing at inlet and ou 
tlet valves,Y,variable valve lift at inlet valves,,,,,,,,,,,,,,,,,,,,,,,,,,GDI,S 
park Ignition Direct Injection,,Y,0W30,34.9,7,7,,DBMXJ02.0N20,5,600, 
2013,BMW,BMW,Z4 sDrive35i,BMX,436,3,6,Auto(AM-S7),17,24,19,21.1097,32.8224,25.14 
8,16.8973,23.5833,19.3682,,TC,Turbocharged,AMS,Automated Manual- Selectable (e.g 
. Automated Manual with paddles),7,N,N,R,10,GP,Gasoline (Premium Unleaded Recomm 
ended),MPG,N,,,,,,,3000,3000,2,2,1,Two Seaters,car,Derived 5-cycle label,8/7/12, 
12492,,N,N,,,N,N,,N,,Y,variable valve timing at inlet and outlet valves,N,,,,,,, 
,,,,,,,,,,,,,,,,,,,,GDI,Spark Ignition Direct Injection,,Y,0W30,25.3,4,4,,DBMXV0 
3.054R,5,,3400 
2013,BMW,BMW,Z4 sDrive35i,BMX,435,3,6,Manual(M6),19,26,21,23.3,36.6,27.855,18.54 
45,26.1997,21.352,,TC,Turbocharged,M,Manual,6,N,N,R,10,GP,Gasoline (Premium Unle 
aded Recommended),MPG,N,,,,,,,2700,2700,2,2,1,Two Seaters,car,Derived 5-cycle la 
bel,8/7/12,11743,,N,N,,,N,N,,N,,Y,variable valve timing at inlet and outlet valv 
es,N,,,,,,,,,,,,,,,,,,,,,,,,,,,GDI,Spark Ignition Direct Injection,,Y,0W30,28.1, 
5,5,,DBMXV03.054R,5,,1900

來源

2014-03-02 user3030048

顯示您'temp.log'文件中的一些示例內容？ –

您在規範中描述的所有內容都可以在1個awk程序中處理。但首先嚐試'echo「$ output」'。傳遞給'echo'的未定義變量會將每個單詞之間的所有空格縮小爲單個空格。要獲得20行標題，只需使用awk的NR（記錄編號）變量，如'if（NR％20）{print「header}'。祝你好運。 – shellter

只是引用$output

echo "$output"

此外，您可能想擺脫多餘的使用cat並做

awk -F ':' '{print $1 "\t" $4 "\t"$5"\t" $6 "\t" $7 "\t" $3}' ./temp.log

代替

來源

2014-03-02 02:41:28 iruvar

...並設置'OFS'使'awk'更清潔。 –

嘗試使用列-t

echo $output | column -t

來源

2014-03-02 02:41:29 Amit

可以使用模函數來顯示標題每個第n行，像這樣：

$ seq 1 12 > moo 
$ awk < moo 'NR%4==0 { print "\nheading\n" } {print} 
      END{ print "total lines: " NR}' 
1 
2 
3 

heading 

4 
5 
6 
7 

heading 

8 
9 
10 
11 

heading 

12 
total lines: 12

來源

2014-03-02 02:50:18

用於格式化管道輸出的bash腳本

回答

相關問題