Re: string_to_array eats too much memory?

Поиск
Список
Период
Сортировка
От Teodor Sigaev
Тема Re: string_to_array eats too much memory?
Дата
Msg-id 45519AEE.8040704@sigaev.ru
обсуждение исходный текст
Ответ на string_to_array eats too much memory?  (Tatsuo Ishii <ishii@sraoss.co.jp>)
Ответы Re: string_to_array eats too much memory?  (Tatsuo Ishii <ishii@sraoss.co.jp>)
Список pgsql-hackers
> I'm playing with GIN to make a full text search system. GIN comes with
> built-in TEXT[] support and I use string_to_array() to make a
> TEXT[]. Problem is, if there's large number of array elemets,
> string_to_array() consumes too much memory. For example, to make ~70k
> array elements, string_to_array seems to eat several Gig bytes of
> memory. ~70k array elements means there are same number of words in a
> document which is not too big in a large text IMO.

Do you mean 70k unique lexemes? Ugh.
Why do not you use tsearch framework?

-- 
Teodor Sigaev                                   E-mail: teodor@sigaev.ru
  WWW: http://www.sigaev.ru/
 


В списке pgsql-hackers по дате отправления:

Предыдущее
От: Teodor Sigaev
Дата:
Сообщение: Re: Index ignored with "is not distinct from", 8.2 beta2
Следующее
От: Teodor Sigaev
Дата:
Сообщение: Re: Tsearch Index Size and GiST vs. GIN