Re: Two proposed modifications to the PostgreSQL FDW

Поиск
Список
Период
Сортировка
От Amit Langote
Тема Re: Two proposed modifications to the PostgreSQL FDW
Дата
Msg-id 4a471794-edb4-821a-e22f-fa7dc8e8b44f@lab.ntt.co.jp
обсуждение исходный текст
Ответ на Re: Two proposed modifications to the PostgreSQL FDW  (Tom Lane <tgl@sss.pgh.pa.us>)
Ответы Re: Two proposed modifications to the PostgreSQL FDW  (Etsuro Fujita <fujita.etsuro@lab.ntt.co.jp>)
Список pgsql-hackers
On 2018/08/20 23:43, Tom Lane wrote:
> Chris Travers <chris.travers@adjust.com> writes:
>> I am looking at trying to make two modifications to the PostgreSQL FDW and
>> would like feedback on this before I do.
> 
>> 1.  INSERTMETHOD=[insert|copy] option on foreign table.
> 
>> One significant limitation of the PostgreSQL FDW is that it does a prepared
>> statement insert on each row written which imposes a per-row latency.  This
>> hits environments where there is significant latency or few latency
>> guarantees particularly hard, for example, writing to a foreign table that
>> might be physically located on another continent.  The idea is that
>> INSERTMETHOD would default to insert and therefore have no changes but
>> where needed people could specify COPY which would stream the data out.
>> Updates would still be unaffected.
> 
> It seems unlikely to me that an FDW option would be at all convenient
> for this.  What about selecting it dynamically based on the planner's
> estimate of the number of rows to be inserted?
> 
> A different thing we could think about is enabling COPY TO/FROM a
> foreign table.

Fwiw, the following commit did introduce COPY FROM support for foreign
tables, although using a FDW INSERT interface, so not exactly optimized
for bulk-loading yet.

commit 3d956d9562aa4811b5eaaaf5314d361c61be2ae0
Author: Robert Haas <rhaas@postgresql.org>
Date:   Fri Apr 6 19:16:11 2018 -0400

    Allow insert and update tuple routing and COPY for foreign tables.

Thanks,
Amit



В списке pgsql-hackers по дате отправления:

Предыдущее
От: Haribabu Kommi
Дата:
Сообщение: Re: Pluggable Storage - Andres's take
Следующее
От: Amit Khandekar
Дата:
Сообщение: Re: Slotification of partition tuple conversion