Oleg,
> I notice tracking why our crawler is slow, that
> pgfoundry generates pages for awfully long time !
> here is excerption from crawler's log:
Within 2 weeks, we'll be moving pgFoundry to a new server where it will run
behind Squid, which should solve this problem.
However, this does explain why the googlebot is slamming us.
--
--Josh
Josh Berkus
Aglio Database Solutions
San Francisco