voussoir/timesearch
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
54 commits 1 branch 0 tags 189 KiB
Commit graph

54 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ethan Dalool
2e2da2b816 Bump version number. 
To date of the last commits.
 2020-01-11 20:30:08 -08:00
Ethan Dalool
43ce535b4f Add argument --offline to redmash, points to offline_reading files. 
Previously, the files generated by offline_reading were difficult
to use because there was no index file and the filenames are just ids.
So now, the redmash can act as an index!
 2020-01-05 20:51:31 -08:00
Ethan Dalool
20c827566f Use DBEntry in redmash to get rid of all this column junk. 2020-01-05 20:40:52 -08:00
Ethan Dalool
f2f1db6bc9 Move the DBEntry class to tsdb. 2020-01-05 20:35:15 -08:00
Ethan Dalool
15009a3409 Refer to this as link instead of shortlink specifically. 
Stay tuned to see why!
 2020-01-05 20:25:35 -08:00
Ethan Dalool
ceb66c772a Separate the generating of html from the writing it. 
I was not happy with the fact that html_from_database actually
performed the file writes. Furthermore the other tool modules have
a titular function that performs the most main task but this one
didn't, it was hidden inside this function. So let's make
html_from_database just a generator and have a function
offline_reading that does what you came here to do.
 2020-01-05 20:07:33 -08:00
Ethan Dalool
7dc240e905 Rename these arguments to indicate they are db rows. 2020-01-05 19:49:27 -08:00
Ethan Dalool
927d5c57a0 Simplify the sql select instead of complicating the else case. 2020-01-05 19:48:40 -08:00
Ethan Dalool
cba93b33e7 Replace bespoke code with call to common.t3_prefix. 2020-01-05 19:29:36 -08:00
Ethan Dalool
330c1b28fa Add <title> to offline_reading pages. 2020-01-05 19:10:27 -08:00
Ethan Dalool
0cdf7bcec5 Put each redmash line into its own div. 
Apparently there are huge browser performance consequences for
having it as lines with brs.
 2020-01-05 18:44:16 -08:00
Ethan Dalool
696fab9178 Woah I forgot I had a version number. 
I'm setting it to the last commit instead of today's date.
 2020-01-05 14:05:45 -08:00
Ethan Dalool
183f1aa5da Point reddit thread link to archive copy. 2019-11-02 17:30:13 -07:00
Ethan Dalool
941351e00f Add archive copy of "reddit removes timestamp search" thread. 2019-11-02 17:21:46 -07:00
Ethan Dalool
6fc6c2238d Apply BSD-3 license. 2019-07-25 18:48:10 -07:00
Ethan Dalool
dba35e3c9b Add a couple retries to pushshift calls. 
I was getting some 503 recently.
 2019-06-25 15:01:10 -07:00
Ethan Dalool
bca5addab3 For failed steps, yield fake 0 instead of artificial wait. 
Because the caller can impose their own wait between steps
of the generator.
 2019-06-25 15:00:38 -07:00
Ethan Dalool
feed4c5621 Add unix timestamp to output so reusing as --lower is easier. 2019-06-25 14:49:50 -07:00
Ethan Dalool
871a56dd81 Replace angle brackets with lt, rt before markdown. 2019-05-02 17:30:14 -07:00
Ethan Dalool
b5160cb6c4 Add some more docstrings here and there. 2018-10-28 22:56:46 -07:00
Ethan Dalool
07ca340c80 Add TSDB.for_submission to remove some duplicate effort. 2018-10-28 22:56:05 -07:00
Ethan Dalool
62bd899e93 Fix bug when only -s is provided to offline_reading. 2018-10-28 22:11:42 -07:00
Ethan Dalool
bfd6466301 Clarify promo posts missing subreddit comment. 2018-07-13 00:45:59 -07:00
Ethan Dalool
385f9f8f63 Add missing <flags> to the breakdown docs. 2018-07-13 00:45:44 -07:00
Ethan Dalool
0f66efc771 No need to default upper, just let it be None. 2018-07-13 00:45:29 -07:00
Ethan Dalool
3e9aa946b1 Allow commentaugment to take lower and upper as well. 2018-04-20 23:29:42 -07:00
Ethan Dalool
5b7eb6870f Fix --once livestreams raising a StopIteration. 2018-04-20 23:18:33 -07:00
Ethan Dalool
9971d853fb Make use of voussoirkit.sqlhelpers for the insert filler. 2018-04-10 16:56:50 -07:00
Ethan Dalool
b3a42daceb Fix typo user.display_name -> user.name. 2018-04-10 16:44:34 -07:00
Ethan Dalool
e6b7ed739b Integrate with Pushshift.io to restore timesearch. 
And improve commentaugment.
 2018-04-09 19:53:53 -07:00
Ethan Dalool
0267f221f0 Move t3_prefix to a helper function. 2018-04-07 20:05:31 -07:00
Ethan Dalool
c7dd46d6ec Add tables submission_edits, comment_edits. Somewhat experimental. 
But as search API reaches EOL anyway it should be fine.
 2018-03-22 17:08:57 -07:00
Ethan Dalool
5eccfb18af Allow a single Livestream instance to work on multiple subs. 
-r subreddit1+subreddit2 -u user1+user2 will manage multiple
independent livestream generators and print the results for all.
 2018-03-22 17:06:07 -07:00
Ethan Dalool
fe7d5534e8 Oops, allow specific_submission to suppress -r -u requirement. 2018-03-22 16:26:27 -07:00
Ethan Dalool
394aa6ec16 Print the migrate query before taking a count. 2018-03-22 16:25:49 -07:00
Ethan Dalool
5d1c2f885d When logging in, reassign the common.r instance. 2018-03-15 19:05:10 -07:00
Ethan Dalool
0ec6002cba Add critical notice. 2018-01-29 19:00:43 -08:00
Ethan Dalool
c185ddaf77 Support usage of filepaths as -r and -u arguments. 
Add `tsdb.name_from_path` so that if the user provides a filepath
as the -r or -u option, we can load their database from that
path and also figure out the subreddit / username to fetch the
subreddit / user object properly, without having to add another
cmd arg for specifying a nonstandard path. New constructor argument
fix_name to perform this automatically and return a tuple of
(database, fixed name).
 2017-12-13 14:42:56 -08:00
Ethan Dalool
278923a000 Add the NotExclusive exception and common.is_xor. 2017-12-13 14:35:36 -08:00
Ethan Dalool
8b98224465 Add the DatabaseOutOfDate exception instead of using ValueError. 2017-12-13 14:22:23 -08:00
Ethan Dalool
b7fcad7cc1 Start exception hierarchy; rename DBNotFound to DatabaseNotFound. 2017-12-13 14:07:52 -08:00
Ethan Dalool
f4d3679063 Remove unnecessary amount of pathclass.Path instantiation. 2017-12-13 13:29:13 -08:00
Ethan Dalool
c87d38a36b Add function generator_printer so it can be used outside. 
This way, people who use _as_a_generator can get the same print
statements as the normal version without rewriting it themselves.
 2017-12-13 12:48:26 -08:00
Ethan Dalool
f7e96975bf Add a collapse [-] button to comment elements. 2017-12-05 15:12:54 -08:00
Ethan Dalool
cae90acfc6 Move responsibility of log formatting to frontend application. 2017-12-05 15:09:12 -08:00
Ethan Dalool
6b4b6040be Fix calling len() on singular Submission / Comment instances. 2017-12-05 08:31:14 -08:00
Ethan Dalool
d1e68a0816 Oops, add the author query for username timesearches. 2017-12-03 11:39:32 -08:00
Ethan Dalool
d54b7937b3 Move HTML templates to global constants; Don't inline CSS. 2017-11-23 20:14:59 -08:00
Ethan Dalool
60a153fba7 Improve division of labor with _as_generator, add some debugs. 
Previously, `livestream` was doing validation and building the
database and then passing it to `_as_a_generator`.
Since that's the only place those things are used, just move them
into there leaving `livestream` looking more simple.
 2017-11-21 21:00:02 -08:00
Ethan Dalool
d59c3d5310 Add some debugs to the insert method. 2017-11-21 20:53:59 -08:00