1
0
mirror of https://github.com/djohnlewis/stackdump synced 2024-12-04 15:07:36 +00:00
Commit Graph

195 Commits

Author SHA1 Message Date
Samuel Lai
e8adaa9b54 Renamed the commands directory and added a script to make them easier to call.
Also deleted the get_sites script as it wasn't very useful, and renamed others
to be more meaningful.
2012-08-18 20:50:13 +10:00
Samuel Lai
e776e95d84 Added an alias for questions for StackExchange style URLs.
This means site_key/questions/question_id is redirected to site_key/question_id.
2012-08-18 20:23:14 +10:00
Samuel Lai
5fc56e4329 Added check to ensure the accepted answer to a question actually exists.
There may be times when it does not exist, e.g. when a question has been merged.
2012-08-18 20:18:26 +10:00
Samuel Lai
9b9b71077c Added informative message when Stackdump is disabled during a site import. 2012-08-18 20:17:15 +10:00
Samuel Lai
2954dd47ba Added a message for questions that have been closed. 2012-08-18 18:40:18 +10:00
Samuel Lai
6181d83cf3 Added a confirmation prompt when importing so the user can confirm site details. 2012-08-18 18:17:00 +10:00
Samuel Lai
9bcac3f92a Fixed some grammar errors in the footer text. 2012-08-18 17:48:55 +10:00
Samuel Lai
ad5f11260a Changed wording from 'posts' to 'questions' on search results pages. 2012-08-18 17:44:57 +10:00
Samuel Lai
827445105b Excess comments (defaults to any over 3) are now hidden by default.
They can be shown by clicking on the 'show comments' link.
2012-08-18 17:44:01 +10:00
Samuel Lai
3d515f51b1 For results with lots of pages, only a limited set of page numbers are rendered. 2012-08-12 16:32:42 +10:00
Samuel Lai
3944261eef Fixed a bug where uncommitted entries from a previously failed import were committed in a later, successful import. 2012-08-12 16:31:30 +10:00
Samuel Lai
1f29fd9113 Modified import.py so it no longer relies on readme.txt.
readme.txt files were dropped as of the August 2012 data dump.
2012-08-12 15:40:48 +10:00
Samuel Lai
dd24d98b39 Upgraded Bottle.py to 0.10.11 and CherryPy to 3.2.2. 2012-08-12 14:57:25 +10:00
Samuel Lai
6156d69af0 Further adjusted start_solr.sh for optimal performance. 2012-08-12 14:17:02 +10:00
Samuel Lai
26b803e119 Improved import speed by ~9-fold by actually committing every 1000 questions.
There was an error made where although questions were only checked for completion every 1000 rows, each completed question was committed separately, resulting in far too many solr calls.

Also modified process to only commit entries in solr at the end, after the database transaction is committed. This means if the process is aborted mid-way through, there won't be orphaned data in solr any more.
2012-08-12 14:13:15 +10:00
Samuel Lai
fdf31a3ef6 Fixed a bug with the previous commit - site object cannot be accessed after transaction has been committed.
Also added an argument so deletes are expunged from the index immediately.
2012-08-12 14:11:16 +10:00
Samuel Lai
6ef90b2ad2 Orphaned entries in solr are also deleted.
Entries are considered orphaned if there is no corresponding database entry, e.g. if an import operation was aborted and hence the database entries were rolled back, but the solr ones were not.
2012-08-07 22:28:21 +10:00
Samuel Lai
9c2e530eff Ordered the list of sites by name. 2012-08-07 22:27:24 +10:00
Samuel Lai
7d6bace28a Stackdump now handles cases where the user has been deleted and does not exist anymore. 2012-08-07 22:07:22 +10:00
Samuel Lai
b1a5977012 Fixed minor styling issue with page title. 2012-08-07 22:06:10 +10:00
Samuel Lai
755a2f2c1f Added some sane default limits for Solr so it doesn't chew up all the RAM.
That tends to happen when importing large datasets.
2012-08-07 19:07:07 +10:00
Samuel Lai
ae208b49ca Fixed a bug where the topbar search box did not have the name attribute.
This caused the search to fail.
2012-08-07 18:52:17 +10:00
Samuel Lai
e38a6e6d0d Fixed a minor bug where if the incorrect version of Python was specified in PYTHON_CMD, no error message was printed and the script just aborted. 2012-08-07 18:51:45 +10:00
Samuel Lai
6013a706d7 Added custom 404 page. 2012-02-12 21:40:35 +11:00
Samuel Lai
9807f0c076 Built licenses pages into the app. 2012-02-12 21:32:48 +11:00
Samuel Lai
1da980424c Links in question view are now parsed and links are re-written where possible to point to the stackdump instance. They are also styled differently to highlight this.
Images are also replaced with a placeholder.
2012-02-12 21:16:07 +11:00
Samuel Lai
5bfcfd2f1a Added an error message when start_python.sh can't find a valid version. 2012-02-12 21:12:33 +11:00
Samuel Lai
105be00e9e Added confirmation when deleting sites. 2012-02-12 21:11:42 +11:00
Samuel Lai
3b1393d9c2 Reduced the number of database calls for the retrieve_sites view helper. 2012-02-12 16:51:14 +11:00
Samuel Lai
f4e2c64de7 Fixed a minor rendering bug where there was no bottom margin for lists. 2012-02-12 16:50:38 +11:00
Samuel Lai
d1ac676db5 Added the site name to the title text for the site logo too. 2012-02-12 15:57:29 +11:00
Samuel Lai
cab37377f7 Added indicator for accepted answer. 2012-02-12 15:54:03 +11:00
Samuel Lai
67f1ac7a3a Added check in the import script to make sure sites aren't inserted with a site key that clashes with Stackdump URLs, e.g. /search or /media. 2012-02-12 14:23:59 +11:00
Samuel Lai
84f5a951ed Re-ordered the Stackdump-wide search method in code so it is processed before the site-specific methods. This means even if a site is imported with the key 'search', it can't replace that page. 2012-02-12 14:19:50 +11:00
Samuel Lai
caebcabd89 Refactored the 'no data' page so the import instructions are accessible even after you've imported your initial dump(s) via a link in the footer. 2012-02-12 14:14:15 +11:00
Samuel Lai
ea0c592fed Very minor adjustment of margins for the site tagline. 2012-02-12 13:58:08 +11:00
Samuel Lai
db3bf11310 Added a 'no data' page with instructions on how to import data into Stackdump. 2012-02-12 13:56:37 +11:00
Samuel Lai
adccd41724 Renamed dataproc management commands to better names. 2012-02-12 13:55:18 +11:00
Samuel Lai
f075580a2e Added indexes to database to speed things up. 2012-02-12 13:54:49 +11:00
Samuel Lai
43f49d1827 Fixed some minor CSS issues, and fixed issues when there is only one site imported in Stackdump. 2012-02-11 22:57:57 +11:00
Samuel Lai
06e210d37a Implemented random questions on home pages. Also consolidated the index pages into a single template. 2012-02-11 22:32:23 +11:00
Samuel Lai
6c58938d44 Changed the default operator to AND properly this time. It has been changed in Solr configuration, instead of hacking the query string. 2012-02-11 21:09:40 +11:00
Samuel Lai
888d7d2e94 Fixed bug where sites without logos were not being correctly served the unknown site logo. 2012-02-11 19:25:21 +11:00
Samuel Lai
b4b2a536e0 Changed from using the route decorator to get because it shows the HTTP methods allowed for that method more clearly. 2012-02-11 19:24:04 +11:00
Samuel Lai
ded9a52d02 Fixed issue where answers were in a difficult-to-read light grey colour. 2012-02-11 19:23:33 +11:00
Samuel Lai
1638617c3e Fixed bug where site_index.html was POSTing the query instead of using GET.
Also fixed issue where errors when searching were not being propagated properly.
2012-02-11 19:20:19 +11:00
Samuel Lai
7363c666d8 Implemented the question view. 2012-02-11 19:08:51 +11:00
Samuel Lai
7dac0dcdea Fixed bug where searching on site search pages would bounce you back to the all sites search page. 2012-02-11 19:08:28 +11:00
Samuel Lai
a4dd607dcc Added missing padding before footer for pages longer than screen height. 2012-02-11 16:44:09 +11:00
Samuel Lai
cda1690be4 Adjusted styling of the 'search all sites' link. 2012-02-11 16:43:34 +11:00