voussoir
ed1b7dc4eb
Add module ingest_jsonfile.
2023-06-25 13:24:39 -07:00
voussoir
643386b88c
Add pushshift announcement.
2023-05-02 21:12:50 -07:00
voussoir
01f2cdbf4a
Render wiki markdown while we're writing it.
2023-04-02 12:25:26 -07:00
voussoir
82bc922cca
Transform comment parent_id from pushshift api.
...
Re #19
2023-02-22 17:50:44 -08:00
voussoir
2c0ae7291a
Hardcode pushshift ratelimit due to removal of /meta.
2023-02-22 17:17:45 -08:00
voussoir
5a4ff3bc02
Add alias offline-reading.
2022-09-29 18:05:35 -07:00
voussoir
c8c160e00e
Take crosspost parent as url when available.
2022-09-10 11:30:58 -07:00
voussoir
08cfa3db0e
Add command aliases with hyphens.
2022-09-07 18:03:54 -07:00
voussoir
806429d3f5
Fix column name of edited text.
...
Why didn't this error before? I shudder to think.
2022-09-03 06:25:38 -07:00
voussoir
d3154e7b51
Update use of sqlhelpers.insert_filler.
2022-08-13 13:07:12 -07:00
voussoir
dfca0e96b6
Use new betterhelp.
2022-02-12 19:54:34 -08:00
voussoir
b2abb29626
Remove unnecessary .absolute_path thanks to fspath.
2021-12-07 12:45:32 -08:00
voussoir
6867d32798
Use separate loggers per module instead of common.log.
...
The separate names assist in debugging.
2021-11-14 13:48:51 -08:00
voussoir
baded8e5fb
Remove --verbose since vlogging handles that.
2021-11-14 13:37:20 -08:00
voussoir
694dddc305
Remove donate.md.
2021-11-10 23:43:13 -08:00
voussoir
925d6d587f
Use old.reddit.com.
2021-11-04 16:37:42 -07:00
voussoir
e8107d9678
Remove separate permalink element, just link the timestamp.
2021-11-04 16:37:37 -07:00
voussoir
58bcc27051
Use vlogging.main_decorator.
2021-11-04 16:35:48 -07:00
voussoir
e938a100a0
Don't call tsdb.for_submission if the subreddit is given.
2021-11-04 16:35:36 -07:00
voussoir
c981137c9b
Change links to old.reddit.com.
2021-07-05 10:50:55 -07:00
voussoir
50f6b02748
Improve OAuth instructions.
2021-07-05 10:50:55 -07:00
voussoir
83fc4ade2e
Update CONTACT.md with link to voussoir.net.
2021-04-04 17:11:20 -07:00
voussoir
f8ab9e96d1
Update license, contact, donate for many projects.
2021-01-14 02:51:21 -08:00
voussoir
e9af8d4cf0
Add Mirrors header.
2020-12-23 19:55:15 -08:00
voussoir
cc3fc1616f
Add codeberg to mirror list.
2020-12-15 23:07:15 -08:00
voussoir
50f61d792c
Print 404 error separately from general stacktrace.
2020-11-27 15:41:08 -08:00
voussoir
14b90ef73c
Add github/gitlab link at bottom of readme.
2020-11-15 17:55:12 -08:00
2750017a17
Use requests.Session.
2020-11-10 20:20:55 -08:00
272c449456
Add --help to "see details on each command".
2020-10-12 22:07:50 -07:00
e2d1f2b9ef
Some small whitespace and log tweaks.
2020-10-08 14:17:19 -07:00
55d9c064bd
Move thank you message into the pushshift module itself.
2020-10-08 13:47:02 -07:00
0aa1ad1596
Use named logger 'timesearch'.
2020-10-08 13:15:58 -07:00
3869e5a99a
Use the same print format for get_submissions and get_comments.
2020-10-08 13:15:05 -07:00
b412b5fd98
Move contents of ts_modules/__init__.py to timesearch.py.
...
I realized that this two-layer launch was unnecessary.
2020-10-08 13:12:57 -07:00
741f47d0b9
Use betterhelp.subparser_main instead of decorator.
...
To get the parser off the global.
2020-10-07 00:32:44 -07:00
c27f8038c7
Use pathclass.Path.makedirs.
2020-09-24 14:19:10 -07:00
3373e36f64
Use pathclass.Path.open.
2020-09-20 18:30:13 -07:00
0bd52eb08b
Bump version to 2020.09.06.0.
2020-09-06 21:44:07 -07:00
eba495e3b7
Increase size of chunks going into db to reduce commit frequency.
2020-09-06 21:43:48 -07:00
5adc0943aa
Use pushshift's /meta endpoint to discover ratelimit.
2020-09-06 21:42:30 -07:00
e136aeea4e
Log the size of received batches from pushshift.
2020-09-06 21:41:44 -07:00
83d5a8e70e
Fix retry loop not breaking after successful try!
2020-09-06 21:31:46 -07:00
4a61d820b3
Add skewer-case aliases for snake_case arguments.
2020-08-12 10:24:31 -07:00
1132c0aee1
Remove unnecessary import requests from merge_db.
2020-05-21 22:30:12 -07:00
10699893ea
Allow get_comments to create the database.
...
This was false because prior to Pushshift, commentaugment worked by
reading the comments tree on every submission, and thus couldn't be
done first. Now, I think there's nothing wrong with getting comments
before submissions.
2020-05-12 18:19:46 -07:00
a56451108d
Add docstring to top of main timesearch.py launch file.
2020-04-22 23:53:04 -07:00
b98f096fd4
Replace "> timesearch.py" with "python timesearch.py"
...
The bracket was meant to look like the command prompt, but for
linux users they would be more used to $ or #, and for people who
do not use the command line often they may be confused by it
altogether. This change should help make it a little more clear as
to what's going on.
2020-04-22 23:25:42 -07:00
30f0fed6c3
Oops, get_submissions block on readme still said timesearch.
2020-03-06 11:35:19 -08:00
45f6e36fad
Add some whitespace between these parts of the help summary.
2020-02-08 21:10:48 -08:00
d64571944f
main should return args.func(args) value.
2020-02-08 17:23:27 -08:00
voussoir
Ethan Dalool