1
0
mirror of https://github.com/djohnlewis/stackdump synced 2024-12-04 23:17:37 +00:00
stackdump by samuel.lai - imported from bitbucket.org/samuel.lai/stackdump
Go to file
Samuel Lai 26b803e119 Improved import speed by ~9-fold by actually committing every 1000 questions.
There was an error made where although questions were only checked for completion every 1000 rows, each completed question was committed separately, resulting in far too many solr calls.

Also modified process to only commit entries in solr at the end, after the database transaction is committed. This means if the process is aborted mid-way through, there won't be orphaned data in solr any more.
2012-08-12 14:13:15 +10:00
java/solr Implemented random questions on home pages. Also consolidated the index pages into a single template. 2012-02-11 22:32:23 +11:00
python Improved import speed by ~9-fold by actually committing every 1000 questions. 2012-08-12 14:13:15 +10:00
.hgignore Added method to make site logos appear if they exist, otherwise show unknown icon. 2011-11-05 12:13:16 +11:00
start_python.sh Fixed a minor bug where if the incorrect version of Python was specified in PYTHON_CMD, no error message was printed and the script just aborted. 2012-08-07 18:51:45 +10:00
start_solr.sh Added some sane default limits for Solr so it doesn't chew up all the RAM. 2012-08-07 19:07:07 +10:00
start_web.sh Moved code into a single stackdump package so code can be shared more easily. 2011-10-30 16:54:49 +11:00