pgsql: Reduce memory consumption for multi-statement query strings.

Поиск
Список
Период
Сортировка
От Tom Lane
Тема pgsql: Reduce memory consumption for multi-statement query strings.
Дата
Msg-id E1hlHOc-0001UM-0K@gemulon.postgresql.org
обсуждение исходный текст
Список pgsql-committers
Reduce memory consumption for multi-statement query strings.

Previously, exec_simple_query always ran parse analysis, rewrite, and
planning in MessageContext, allowing all the data generated thereby
to persist until the end of processing of the whole query string.
That's fine for single-command strings, but if a client sends many
commands in a single simple-Query message, this strategy could result
in annoying memory bloat, as complained of by Andreas Seltenreich.

To fix, create a child context to do this work in, and reclaim it
after each command.  But we only do so for parsetrees that are not
last in their query string.  That avoids adding any memory management
overhead for the typical case of a single-command string.  Memory
allocated for the last parsetree would be freed immediately after
finishing the command string anyway.

Similarly, adjust extension.c's execute_sql_string() to reclaim memory
after each command.  In that usage, multi-command strings are the norm,
so it's a bit surprising that no one has yet complained of bloat ---
especially since the bloat extended to whatever data ProcessUtility
execution might leak.

Amit Langote, reviewed by Julien Rouhaud

Discussion: https://postgr.es/m/87ftp6l2qr.fsf@credativ.de

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/b5810de3f4eb0e7b242d31db93a46957d56ea8b4

Modified Files
--------------
src/backend/commands/extension.c | 16 ++++++++++++++++
src/backend/tcop/postgres.c      | 30 +++++++++++++++++++++++++-----
2 files changed, 41 insertions(+), 5 deletions(-)


В списке pgsql-committers по дате отправления:

Предыдущее
От: Bruce Momjian
Дата:
Сообщение: pgsql: docs: remove pg_roles mention of the oid column being displayed
Следующее
От: Alexander Korotkov
Дата:
Сообщение: pgsql: Fixes for jsonpath filter expression elements table in docs