2017-07-18 30 views
2

下面是我用它來創建雙克頻率列表的代碼:R:獲得單詞頻,而不是二元語法

library(tm) 
library(RWeka) 
#data <- myData[,2] 


tdm.generate <- function(string, ng){ 

    # tutorial on rweka - http://tm.r-forge.r-project.org/faq.html 

    corpus <- Corpus(VectorSource(string)) # create corpus for TM processing 
    corpus <- tm_map(corpus, content_transformer(tolower)) 
    corpus <- tm_map(corpus, removeNumbers) 
    corpus <- tm_map(corpus, removePunctuation) 
    corpus <- tm_map(corpus, stripWhitespace) 
    # corpus <- tm_map(corpus, removeWords, stopwords("english")) 
    options(mc.cores=1) # http://stackoverflow.com/questions/17703553/bigrams-instead-of-single-words-in-termdocument-matrix-using-r-and-rweka/20251039#20251039 
    BigramTokenizer <- function(x) NGramTokenizer(x, Weka_control(min = ng, max = ng)) # create n-grams 
    tdm <- TermDocumentMatrix(corpus, control = list(tokenize = BigramTokenizer)) # create tdm from n-grams 
    tdm 
} 



source("GenerateTDM.R") # generatetdm function in appendix 
tdm <- tdm.generate("The book The book The greatest The book",2) 

tdm.matrix <- as.matrix(tdm) 
topwords <- rowSums(tdm.matrix) 
topwords <- as.numeric(topwords) 
hist(topwords, breaks = 10) 


tdm.matrix <- as.matrix(tdm) 
topwords <- rowSums(tdm.matrix) 
head(sort(topwords, decreasing = TRUE)) 

上面的代碼的結果是:

the  book greatest 
4  3  1 

相反,我正在尋找雙克顯示的結果,例如:

"the book" "book the" 
    3   2 

需要在上面的代碼中更改哪些內容才能獲得輸出如上?

回答

1

你需要使用VCorpus而不是語料庫,我有同樣的問題,你可以檢查更多的細節here