2016-09-07 81 views
0

我有一個任務:從每個羣組(按時間)獲取數據的第一個,最後一個,最大,最小值。我的解決方案有效,但速度非常緩慢,因爲表中的行數約爲5000萬。羣組的最後和第一個值

我怎樣才能提高此查詢的性能:

SELECT 
    date_trunc('minute', t_ordered."timestamp"), 
    MIN (t_ordered.price), 
    MAX (t_ordered.price), 
    FIRST (t_ordered.price), 
    LAST (t_ordered.price) 
FROM(
    SELECT t.price, t."timestamp" 
    FROM trade t 
    WHERE t."timestamp" >= '2016-01-01' AND t."timestamp" < '2016-09-01' 
    ORDER BY t."timestamp" ASC 
) t_ordered 
GROUP BY 1 
ORDER BY 1 

第一個和最後都是集合函數from postgresql wiki

timestamp列索引。 解釋(分析,詳細):

GroupAggregate (cost=13112830.84..33300949.59 rows=351556 width=14) (actual time=229538.092..468212.450 rows=351138 loops=1) 
    Output: (date_trunc('minute'::text, t_ordered."timestamp")), min(t_ordered.price), max(t_ordered.price), first(t_ordered.price), last(t_ordered.price) 
     Group Key: (date_trunc('minute'::text, t_ordered."timestamp")) 
     -> Sort (cost=13112830.84..13211770.66 rows=39575930 width=14) (actual time=229515.281..242472.677 rows=38721704 loops=1) 
     Output: (date_trunc('minute'::text, t_ordered."timestamp")), t_ordered.price 
     Sort Key: (date_trunc('minute'::text, t_ordered."timestamp")) 
     Sort Method: external sort Disk: 932656kB 
     -> Subquery Scan on t_ordered (cost=6848734.55..7442373.50 rows=39575930 width=14) (actual time=102166.368..155540.492 rows=38721704 loops=1) 
      Output: date_trunc('minute'::text, t_ordered."timestamp"), t_ordered.price 
      -> Sort (cost=6848734.55..6947674.38 rows=39575930 width=14) (actual time=102165.836..130971.804 rows=38721704 loops=1) 
       Output: t.price, t."timestamp" 
       Sort Key: t."timestamp" 
       Sort Method: external merge Disk: 993480kB 
       -> Seq Scan on public.trade t (cost=0.00..1178277.21 rows=39575930 width=14) (actual time=0.055..25726.038 rows=38721704 loops=1) 
         Output: t.price, t."timestamp" 
         Filter: ((t."timestamp" >= '2016-01-01 00:00:00'::timestamp without time zone) AND (t."timestamp" < '2016-09-01 00:00:00'::timestamp without time zone)) 
         Rows Removed by Filter: 9666450 
Planning time: 1.663 ms 
Execution time: 468949.753 ms 

也許它可以通過窗函數來完成?我曾經試過,但我沒有足夠的知識來使用它們

+0

內部查詢的性能和行數是多少? –

+0

如果在子查詢中刪除「first()」,「last()」和「order by」,性能如何? –

+0

子查詢查詢的行數約爲6百萬 – LifeIsGoodMF

回答

1

創建類型和足夠的聚集將有望更好的工作:

create type tp as (timestamp timestamp, price int); 

create or replace function min_tp (tp, tp) 
returns tp as $$ 
    select least($1, $2); 
$$ language sql immutable; 

create aggregate min (tp) (
    sfunc = min_tp, 
    stype = tp 
); 

minmax(未上市)聚合函數會降低查詢單迴路:

select 
    date_trunc('minute', timestamp) as minute, 
    min (price) as price_min, 
    max (price) as price_max, 
    (min ((timestamp, price)::tp)).price as first, 
    (max ((timestamp, price)::tp)).price as last 
from t 
where timestamp >= '2016-01-01' and timestamp < '2016-09-01' 
group by 1 
order by 1 

解釋(分析,詳細):

GroupAggregate (cost=6954022.61..27159050.82 rows=287533 width=14) (actual time=129286.817..510119.582 rows=351138 loops=1) 
    Output: (date_trunc('minute'::text, "timestamp")), min(price), max(price), (min(ROW("timestamp", price)::tp)).price, (max(ROW("timestamp", price)::tp)).price 
    Group Key: (date_trunc('minute'::text, trade."timestamp")) 
    -> Sort (cost=6954022.61..7053049.25 rows=39610655 width=14) (actual time=129232.165..156277.718 rows=38721704 loops=1) 
     Output: (date_trunc('minute'::text, "timestamp")), price, "timestamp" 
     Sort Key: (date_trunc('minute'::text, trade."timestamp")) 
     Sort Method: external merge Disk: 1296392kB 
     -> Seq Scan on public.trade (cost=0.00..1278337.71 rows=39610655 width=14) (actual time=0.035..45335.947 rows=38721704 loops=1) 
      Output: date_trunc('minute'::text, "timestamp"), price, "timestamp" 
      Filter: ((trade."timestamp" >= '2016-01-01 00:00:00'::timestamp without time zone) AND (trade."timestamp" < '2016-09-01 00:00:00'::timestamp without time zone)) 
      Rows Removed by Filter: 9708857 
Planning time: 0.286 ms 
Execution time: 510648.395 ms 
+0

感謝它看起來更好。如何讓postgres在內存中執行'Sort Method:external merge Disk:1296392kB'? – LifeIsGoodMF

+0

@ user2500146檢查'postgresql.conf'中的'work_mem'值。測試索引'在t上創建索引分鐘(date_trunc('minute',timestamp))' –

相關問題