1
0
mirror of https://github.com/djohnlewis/stackdump synced 2025-01-22 14:41:39 +00:00
stackdump/python
Samuel Lai 26b803e119 Improved import speed by ~9-fold by actually committing every 1000 questions.
There was an error made where although questions were only checked for completion every 1000 rows, each completed question was committed separately, resulting in far too many solr calls.

Also modified process to only commit entries in solr at the end, after the database transaction is committed. This means if the process is aborted mid-way through, there won't be orphaned data in solr any more.
2012-08-12 14:13:15 +10:00
..
media Links in question view are now parsed and links are re-written where possible to point to the stackdump instance. They are also styled differently to highlight this. 2012-02-12 21:16:07 +11:00
packages Links in question view are now parsed and links are re-written where possible to point to the stackdump instance. They are also styled differently to highlight this. 2012-02-12 21:16:07 +11:00
src/stackdump Improved import speed by ~9-fold by actually committing every 1000 questions. 2012-08-12 14:13:15 +10:00