Commit Graph

93 Commits (0bd52eb08b1967b5ec56f0b4057e23a8a5c65d29)

Author SHA1 Message Date
Ethan Dalool 696fab9178 Woah I forgot I had a version number.
I'm setting it to the last commit instead of today's date.
2020-01-05 14:05:45 -08:00
Ethan Dalool 183f1aa5da Point reddit thread link to archive copy. 2019-11-02 17:30:13 -07:00
Ethan Dalool 941351e00f Add archive copy of "reddit removes timestamp search" thread. 2019-11-02 17:21:46 -07:00
Ethan Dalool 6fc6c2238d Apply BSD-3 license. 2019-07-25 18:48:10 -07:00
Ethan Dalool dba35e3c9b Add a couple retries to pushshift calls.
I was getting some 503 recently.
2019-06-25 15:01:10 -07:00
Ethan Dalool bca5addab3 For failed steps, yield fake 0 instead of artificial wait.
Because the caller can impose their own wait between steps
of the generator.
2019-06-25 15:00:38 -07:00
Ethan Dalool feed4c5621 Add unix timestamp to output so reusing as --lower is easier. 2019-06-25 14:49:50 -07:00
Ethan Dalool 871a56dd81 Replace angle brackets with lt, rt before markdown. 2019-05-02 17:30:14 -07:00
Ethan Dalool b5160cb6c4 Add some more docstrings here and there. 2018-10-28 22:56:46 -07:00
Ethan Dalool 07ca340c80 Add TSDB.for_submission to remove some duplicate effort. 2018-10-28 22:56:05 -07:00
Ethan Dalool 62bd899e93 Fix bug when only -s is provided to offline_reading. 2018-10-28 22:11:42 -07:00
Ethan Dalool bfd6466301 Clarify promo posts missing subreddit comment. 2018-07-13 00:45:59 -07:00
Ethan Dalool 385f9f8f63 Add missing <flags> to the breakdown docs. 2018-07-13 00:45:44 -07:00
Ethan Dalool 0f66efc771 No need to default `upper`, just let it be None. 2018-07-13 00:45:29 -07:00
Ethan Dalool 3e9aa946b1 Allow commentaugment to take lower and upper as well. 2018-04-20 23:29:42 -07:00
Ethan Dalool 5b7eb6870f Fix --once livestreams raising a StopIteration. 2018-04-20 23:18:33 -07:00
Ethan Dalool 9971d853fb Make use of voussoirkit.sqlhelpers for the insert filler. 2018-04-10 16:56:50 -07:00
Ethan Dalool b3a42daceb Fix typo user.display_name -> user.name. 2018-04-10 16:44:34 -07:00
Ethan Dalool e6b7ed739b Integrate with Pushshift.io to restore timesearch.
And improve commentaugment.
2018-04-09 19:53:53 -07:00
Ethan Dalool 0267f221f0 Move t3_prefix to a helper function. 2018-04-07 20:05:31 -07:00
Ethan Dalool c7dd46d6ec Add tables submission_edits, comment_edits. Somewhat experimental.
But as search API reaches EOL anyway it should be fine.
2018-03-22 17:08:57 -07:00
Ethan Dalool 5eccfb18af Allow a single Livestream instance to work on multiple subs.
-r subreddit1+subreddit2 -u user1+user2 will manage multiple
independent livestream generators and print the results for all.
2018-03-22 17:06:07 -07:00
Ethan Dalool fe7d5534e8 Oops, allow specific_submission to suppress -r -u requirement. 2018-03-22 16:26:27 -07:00
Ethan Dalool 394aa6ec16 Print the migrate query before taking a count. 2018-03-22 16:25:49 -07:00
Ethan Dalool 5d1c2f885d When logging in, reassign the common.r instance. 2018-03-15 19:05:10 -07:00
Ethan Dalool 0ec6002cba Add critical notice. 2018-01-29 19:00:43 -08:00
Ethan Dalool c185ddaf77 Support usage of filepaths as -r and -u arguments.
Add `tsdb.name_from_path` so that if the user provides a filepath
as the -r or -u option, we can load their database from that
path and also figure out the subreddit / username to fetch the
subreddit / user object properly, without having to add another
cmd arg for specifying a nonstandard path. New constructor argument
fix_name to perform this automatically and return a tuple of
(database, fixed name).
2017-12-13 14:42:56 -08:00
Ethan Dalool 278923a000 Add the NotExclusive exception and common.is_xor. 2017-12-13 14:35:36 -08:00
Ethan Dalool 8b98224465 Add the DatabaseOutOfDate exception instead of using ValueError. 2017-12-13 14:22:23 -08:00
Ethan Dalool b7fcad7cc1 Start exception hierarchy; rename DBNotFound to DatabaseNotFound. 2017-12-13 14:07:52 -08:00
Ethan Dalool f4d3679063 Remove unnecessary amount of pathclass.Path instantiation. 2017-12-13 13:29:13 -08:00
Ethan Dalool c87d38a36b Add function `generator_printer` so it can be used outside.
This way, people who use _as_a_generator can get the same print
statements as the normal version without rewriting it themselves.
2017-12-13 12:48:26 -08:00
Ethan Dalool f7e96975bf Add a collapse [-] button to comment elements. 2017-12-05 15:12:54 -08:00
Ethan Dalool cae90acfc6 Move responsibility of log formatting to frontend application. 2017-12-05 15:09:12 -08:00
Ethan Dalool 6b4b6040be Fix calling len() on singular Submission / Comment instances. 2017-12-05 08:31:14 -08:00
Ethan Dalool d1e68a0816 Oops, add the author query for username timesearches. 2017-12-03 11:39:32 -08:00
Ethan Dalool d54b7937b3 Move HTML templates to global constants; Don't inline CSS. 2017-11-23 20:14:59 -08:00
Ethan Dalool 60a153fba7 Improve division of labor with _as_generator, add some debugs.
Previously, `livestream` was doing validation and building the
database and then passing it to `_as_a_generator`.
Since that's the only place those things are used, just move them
into there leaving `livestream` looking more simple.
2017-11-21 21:00:02 -08:00
Ethan Dalool d59c3d5310 Add some debugs to the `insert` method. 2017-11-21 20:53:59 -08:00
Ethan Dalool 89bcc1717e Add a logger. 2017-11-21 19:59:26 -08:00
Ethan Dalool 7ef5a8ceee Add table `config` for meta settings. 2017-11-15 20:40:52 -08:00
Ethan Dalool 2b71ec3c76 Start tracking database user_version for potential upgrades. 2017-11-15 20:22:29 -08:00
Ethan Dalool 708c774e52 Initial migratory commit from voussoir/reddit. 2017-11-13 19:13:19 -08:00