如何使用BigQuery查找最常用的雙元素？

Question

我想在我的表格中找到最常見的二元組（雙字）。我如何使用BigQuery來做到這一點？

Answer 1

大量查詢現在支持SPLIT（）：

SELECT word, nextword, COUNT(*) c 
FROM (
SELECT pos, title, word, LEAD(word) OVER(PARTITION BY created_utc,title ORDER BY pos) nextword FROM (
SELECT created_utc, title, word, pos FROM FLATTEN(
    (SELECT created_utc, title, word, POSITION(word) pos FROM 
    (SELECT created_utc, title, SPLIT(title, ' ') word FROM [bigquery-samples:reddit.full]) 
), word) 
)) 
WHERE nextword IS NOT null 
GROUP EACH BY 1, 2 
ORDER BY c DESC 
LIMIT 100