mirror of
https://github.com/djohnlewis/stackdump
synced 2024-12-04 23:17:37 +00:00
stackdump by samuel.lai - imported from bitbucket.org/samuel.lai/stackdump
26b803e119
There was an error made where although questions were only checked for completion every 1000 rows, each completed question was committed separately, resulting in far too many solr calls. Also modified process to only commit entries in solr at the end, after the database transaction is committed. This means if the process is aborted mid-way through, there won't be orphaned data in solr any more. |
||
---|---|---|
java/solr | ||
python | ||
.hgignore | ||
start_python.sh | ||
start_solr.sh | ||
start_web.sh |