reindex option for tuning load large data

Поиск
Список
Период
Сортировка
От James Pang (chaolpan)
Тема reindex option for tuning load large data
Дата
Msg-id PH0PR11MB51911D09840DC7BD6069678ED6AF9@PH0PR11MB5191.namprd11.prod.outlook.com
обсуждение исходный текст
Ответы Re: reindex option for tuning load large data  (Vitalii Tymchyshyn <vit@tym.im>)
Re: reindex option for tuning load large data  (Jeff Janes <jeff.janes@gmail.com>)
Список pgsql-performance

Hi ,

  We plan to migrate large database from Oracle to Postgres(version 13.6, OS Redhat8 Enterprise), we are checking options to make data load in Postgres fast. Data volume is about several TB,  thousands of indexes,  many large table with partitions.  We want to make data load running fast and avoid miss any indexes when reindexing. There are 2 options about reindex. Could you give some suggestions about the 2 options, which option is better.

 

  1. Create tables and indexes( empty database) ,   update pg_index set indisready=false and inisvalid=false,  then  load data use COPY from csv ,  then reindex table …

Reindex on Postgres 13.6 not support parallel ,right?  So we need to start multiple session to reindex  multiple tables/indexes in parallel.

 

 

2).  Use pg_dump to dump meta data only , then copy “CREATE INDEX … sql “

        Drop indexes before data load

       After data load, increase max_parallel_maintenance_workers, maintenance_work_mem

       Run CREATE INDEX … sql  to leverage parallel create index feature.

 

 

 

Thanks,

 

James  

 

 

В списке pgsql-performance по дате отправления:

Предыдущее
От: "David G. Johnston"
Дата:
Сообщение: Re: Missed query planner optimization: `n in (select q)` -> `n in (q)`
Следующее
От: Vitalii Tymchyshyn
Дата:
Сообщение: Re: reindex option for tuning load large data