Re: [PERFORM] Query with no result set, really really slow addingORBDER BY / LIMIT clause

Поиск
Список
Период
Сортировка
От Pavel Stehule
Тема Re: [PERFORM] Query with no result set, really really slow addingORBDER BY / LIMIT clause
Дата
Msg-id CAFj8pRBEHSw-CEAgLga7LcViiBo8k5sG95A4hpxM+2ju2PPhEg@mail.gmail.com
обсуждение исходный текст
Ответ на Re: [PERFORM] Query with no result set, really really slow addingORBDER BY / LIMIT clause  (Marco Renzi <renzi.mrc@gmail.com>)
Ответы Re: [PERFORM] Query with no result set, really really slow addingORBDER BY / LIMIT clause  (Marco Renzi <renzi.mrc@gmail.com>)
Список pgsql-performance


2017-04-21 8:49 GMT+02:00 Marco Renzi <renzi.mrc@gmail.com>:
This could look strange, but is fast as hell!
The main problem is:
Is everytime ok doing query like this with order by and limit? Is ok using an upperlimit to 1.000.000.000 records?

I am thinking so limit 10000 should be ok. Too big number can be messy for optimizer similarly like too small number.

The planner is driven by statistics - and the statistics are not perfect - usually it is working on 80% - like weather forecasting.

Usually it is working, but sometimes not.

Regards

Pavel
 

SELECT * FROM (
SELECT  fase.id
FROM            tipofase
JOIN       fase
ON         (fase.tipofase = tipofase.id)
WHERE agendafrontoffice = true
ORDER BY        fase.id DESC   limit 1000000000 offset 0
) A
ORDER BY        A.id DESC   limit 10 offset 0

2017-04-20 18:05 GMT+02:00 Pavel Stehule <pavel.stehule@gmail.com>:



I am afraid so is not possible to solve this issue by one query. In this case the planner expects early stop due finding few values. But because there are not any value, the LIMIT clause has not any benefit in executor time, but the planner is messed. Maybe try to increase LIMIT to some higher value .. 1000, 10000 so planner don't fall to this trap. PostgreSQL statistics are about most common values, but the values without any occurrence are not well registered by statistics.

Regards

It can looks strange, but it can work

SELECT *
   FROM (your query ORDER BY .. OFFSET 0 LIMIT 10000) s
  ORDER BY ...
  LIMIT 10;

Regards

Pavel

В списке pgsql-performance по дате отправления:

Предыдущее
От: Marco Renzi
Дата:
Сообщение: Re: [PERFORM] Query with no result set, really really slow addingORBDER BY / LIMIT clause
Следующее
От: Marco Renzi
Дата:
Сообщение: Re: [PERFORM] Query with no result set, really really slow addingORBDER BY / LIMIT clause