voussoir
50f61d792c
Print 404 error separately from general stacktrace.
2020-11-27 15:41:08 -08:00
2750017a17
Use requests.Session.
2020-11-10 20:20:55 -08:00
e2d1f2b9ef
Some small whitespace and log tweaks.
2020-10-08 14:17:19 -07:00
55d9c064bd
Move thank you message into the pushshift module itself.
2020-10-08 13:47:02 -07:00
0aa1ad1596
Use named logger 'timesearch'.
2020-10-08 13:15:58 -07:00
3869e5a99a
Use the same print format for get_submissions and get_comments.
2020-10-08 13:15:05 -07:00
b412b5fd98
Move contents of ts_modules/__init__.py to timesearch.py.
...
I realized that this two-layer launch was unnecessary.
2020-10-08 13:12:57 -07:00
741f47d0b9
Use betterhelp.subparser_main instead of decorator.
...
To get the parser off the global.
2020-10-07 00:32:44 -07:00
c27f8038c7
Use pathclass.Path.makedirs.
2020-09-24 14:19:10 -07:00
3373e36f64
Use pathclass.Path.open.
2020-09-20 18:30:13 -07:00
0bd52eb08b
Bump version to 2020.09.06.0.
2020-09-06 21:44:07 -07:00
eba495e3b7
Increase size of chunks going into db to reduce commit frequency.
2020-09-06 21:43:48 -07:00
5adc0943aa
Use pushshift's /meta endpoint to discover ratelimit.
2020-09-06 21:42:30 -07:00
e136aeea4e
Log the size of received batches from pushshift.
2020-09-06 21:41:44 -07:00
83d5a8e70e
Fix retry loop not breaking after successful try!
2020-09-06 21:31:46 -07:00
4a61d820b3
Add skewer-case aliases for snake_case arguments.
2020-08-12 10:24:31 -07:00
1132c0aee1
Remove unnecessary import requests from merge_db.
2020-05-21 22:30:12 -07:00
10699893ea
Allow get_comments to create the database.
...
This was false because prior to Pushshift, commentaugment worked by
reading the comments tree on every submission, and thus couldn't be
done first. Now, I think there's nothing wrong with getting comments
before submissions.
2020-05-12 18:19:46 -07:00
b98f096fd4
Replace "> timesearch.py" with "python timesearch.py"
...
The bracket was meant to look like the command prompt, but for
linux users they would be more used to $ or #, and for people who
do not use the command line often they may be confused by it
altogether. This change should help make it a little more clear as
to what's going on.
2020-04-22 23:25:42 -07:00
45f6e36fad
Add some whitespace between these parts of the help summary.
2020-02-08 21:10:48 -08:00
d027cce562
main should return args.func(args) value.
2020-02-08 16:20:19 -08:00
263232e0a0
I keep forgetting I have a version number.
2020-02-08 15:51:59 -08:00
dd38e0c8da
Print a helpful message when bot.py or bot4.py isn't found.
2020-02-08 15:51:45 -08:00
5345e8f4fc
Use betterhelp to manage docstrings, aliases, and helptexts.
2020-01-30 23:25:24 -08:00
31296000f9
Alphabetize & organize helptexts with new names.
2020-01-27 20:13:01 -08:00
02b2dc166e
Fix docstring incorrectly referring to constants.
2020-01-27 20:09:02 -08:00
24f155a40d
Update OutOfDate message to show actual argument.
2020-01-27 20:00:08 -08:00
d12e66f19c
DB v2. Rename redmash folder to index.
2020-01-27 19:53:27 -08:00
0ef423d780
Create _first_time_setup, _load_pragmas, and _check_version.
2020-01-27 19:51:23 -08:00
ecfb96820c
Correct index helptext to say index instead of mash.
2020-01-27 19:21:41 -08:00
1fb281bf7f
Rename mergedb.py -> merge_db.py.
2020-01-27 18:57:06 -08:00
d2220a3ced
Rename getwiki.py -> get_wiki.py.
2020-01-27 18:54:04 -08:00
6b0dd55431
Rename getstyles.py -> get_styles.py.
2020-01-27 18:53:19 -08:00
2022db2b0c
Rename redmash.py -> index.py.
2020-01-27 18:45:36 -08:00
744dadd3ee
Rename commentaugment.py -> get_comments.py.
2020-01-27 18:41:58 -08:00
75648343e2
Rename timesearch.py -> get_submissions.py.
2020-01-27 18:39:54 -08:00
b3db322a78
Rename timesearch directory -> timesearch_modules.
...
This marks the first in a long series of rename commits.
Hold on to your databases!
2020-01-27 18:32:05 -08:00
voussoir
Ethan Dalool