如何使用sed/awk從文件中刪除文本塊（模式）

Question

我有成千上萬的文本文件，我已經導入了包含一段我想刪除的文本。

它不只是一個文本塊，而是一個模式。

<!-- 
# Translator(s): 
# 
# username1 <email1> 
# username2 <email2> 
# usernameN <emailN> 
# 
--> 

該塊如果出現，將有一個或多個用戶列出他們的電子郵件地址。

Answer 1

對於此任務，您需要向前看，這通常是使用解析器完成的。

另一種解決方案，但不是非常有效的將是：

sed "s/-->/&\n/;s/<!--/\n&/" file | awk 'BEGIN {RS = "";FS = "\n"}/username/{print}' 

HTH克里斯

Answer 2

這裏是我的解決方案，如果我理解正確你的問題。保存到以下一個名爲remove_blocks.awk：

# See the beginning of the block, mark it 
/<!--/ { 
    state = "block_started" 
} 

# At the end of the block, if the block does not contain email, print 
# out the whole block. 
/^-->/ { 
    if (!block_contains_user_email) { 
     for (i = 0; i < count; i++) { 
      print saved_line[i]; 
     } 
     print 
    } 

    count = 0 
    block_contains_user_email = 0 
    state = "" 
    next 
} 

# Encounter a block: save the lines and wait until the end of the block 
# to decide if we should print it out 
state == "block_started" { 
    saved_line[count++] = $0 
    if (NF>=3 && $3 ~ /@/) { 
     block_contains_user_email = 1 
    } 
    next 
} 

# For everything else, print the line 
1 

假設您的文本文件是data.txt中（或多個文件，對於這個問題）：

awk -f remove_blocks.awk data.txt 

上述命令將打印將文本文件中的所有內容減去包含用戶電子郵件的塊。

Answer 3

perl -i.orig -00 -pe 's/<!--\s+#\s*Translator.*?\s-->//gs' file1 file2 file3 

Answer 4

這SED解決方案可能的工作：

sed '/^<!--/,/^-->/{/^<!--/{h;d};H;/^-->/{x;/^<!--\n# Translator(s):\n#\(\n# [^<]*<email[0-9]\+>\)\+\n#\n-->$/!p};d}' file 

Answer 5

我有完成任務的代碼非常少排另一個小awk程序。它可以用來從文件中刪除文本的模式。開始以及停止regexp可以設置。

# This block is a range pattern and captures all lines between(and including) 
# the start '<!--' to the end '-->' and stores the content in record $0. 
# Record $0 contains every line in the range pattern. 
# awk -f remove_email.awk yourfile 

# The if statement is not needed to accomplish the task, but may be useful. 
# It says - if the range patterns in $0 contains a '@' then it will print 
# the string "Found an email..." if uncommented. 

# command 'next' will discard the content of the current record and search 
# for the next record. 
# At the same time the awk program begins from the beginning. 


/<!--/, /-->/ { 
    #if($0 ~ /@/){ 
     # print "Found an email and removed that!" 
    #} 
next 
} 

# This line prints the body of the file to standard output - if not captured in 
# the block above. 
1 { 
    print 
} 

保存在 'remove_email.awk' 的代碼和運行它： AWK -f remove_email.awk yourfile