19bd53115e
Fix reference to new name timesearch_modules.
2020-01-27 18:58:04 -08:00
1fb281bf7f
Rename mergedb.py -> merge_db.py.
2020-01-27 18:57:06 -08:00
d2220a3ced
Rename getwiki.py -> get_wiki.py.
2020-01-27 18:54:04 -08:00
6b0dd55431
Rename getstyles.py -> get_styles.py.
2020-01-27 18:53:19 -08:00
2022db2b0c
Rename redmash.py -> index.py.
2020-01-27 18:45:36 -08:00
744dadd3ee
Rename commentaugment.py -> get_comments.py.
2020-01-27 18:41:58 -08:00
75648343e2
Rename timesearch.py -> get_submissions.py.
2020-01-27 18:39:54 -08:00
b3db322a78
Rename timesearch directory -> timesearch_modules.
...
This marks the first in a long series of rename commits.
Hold on to your databases!
2020-01-27 18:32:05 -08:00
28216c76e1
Add timesearch_logo.svg.
2020-01-19 10:58:20 -08:00
2e2da2b816
Bump version number.
...
To date of the last commits.
2020-01-11 20:30:08 -08:00
43ce535b4f
Add argument --offline to redmash, points to offline_reading files.
...
Previously, the files generated by offline_reading were difficult
to use because there was no index file and the filenames are just ids.
So now, the redmash can act as an index!
2020-01-05 20:51:31 -08:00
20c827566f
Use DBEntry in redmash to get rid of all this column junk.
2020-01-05 20:40:52 -08:00
f2f1db6bc9
Move the DBEntry class to tsdb.
2020-01-05 20:35:15 -08:00
15009a3409
Refer to this as link instead of shortlink specifically.
...
Stay tuned to see why!
2020-01-05 20:25:35 -08:00
ceb66c772a
Separate the generating of html from the writing it.
...
I was not happy with the fact that html_from_database actually
performed the file writes. Furthermore the other tool modules have
a titular function that performs the most main task but this one
didn't, it was hidden inside this function. So let's make
html_from_database just a generator and have a function
offline_reading that does what you came here to do.
2020-01-05 20:07:33 -08:00
7dc240e905
Rename these arguments to indicate they are db rows.
2020-01-05 19:49:27 -08:00
927d5c57a0
Simplify the sql select instead of complicating the else case.
2020-01-05 19:48:40 -08:00
cba93b33e7
Replace bespoke code with call to common.t3_prefix.
2020-01-05 19:29:36 -08:00
330c1b28fa
Add <title> to offline_reading pages.
2020-01-05 19:10:27 -08:00
0cdf7bcec5
Put each redmash line into its own div.
...
Apparently there are huge browser performance consequences for
having it as lines with brs.
2020-01-05 18:44:16 -08:00
696fab9178
Woah I forgot I had a version number.
...
I'm setting it to the last commit instead of today's date.
2020-01-05 14:05:45 -08:00
183f1aa5da
Point reddit thread link to archive copy.
2019-11-02 17:30:13 -07:00
941351e00f
Add archive copy of "reddit removes timestamp search" thread.
2019-11-02 17:21:46 -07:00
6fc6c2238d
Apply BSD-3 license.
2019-07-25 18:48:10 -07:00
dba35e3c9b
Add a couple retries to pushshift calls.
...
I was getting some 503 recently.
2019-06-25 15:01:10 -07:00
bca5addab3
For failed steps, yield fake 0 instead of artificial wait.
...
Because the caller can impose their own wait between steps
of the generator.
2019-06-25 15:00:38 -07:00
feed4c5621
Add unix timestamp to output so reusing as --lower is easier.
2019-06-25 14:49:50 -07:00
871a56dd81
Replace angle brackets with lt, rt before markdown.
2019-05-02 17:30:14 -07:00
b5160cb6c4
Add some more docstrings here and there.
2018-10-28 22:56:46 -07:00
07ca340c80
Add TSDB.for_submission to remove some duplicate effort.
2018-10-28 22:56:05 -07:00
62bd899e93
Fix bug when only -s is provided to offline_reading.
2018-10-28 22:11:42 -07:00
bfd6466301
Clarify promo posts missing subreddit comment.
2018-07-13 00:45:59 -07:00
385f9f8f63
Add missing <flags> to the breakdown docs.
2018-07-13 00:45:44 -07:00
0f66efc771
No need to default `upper`, just let it be None.
2018-07-13 00:45:29 -07:00
3e9aa946b1
Allow commentaugment to take lower and upper as well.
2018-04-20 23:29:42 -07:00
5b7eb6870f
Fix --once livestreams raising a StopIteration.
2018-04-20 23:18:33 -07:00
9971d853fb
Make use of voussoirkit.sqlhelpers for the insert filler.
2018-04-10 16:56:50 -07:00
b3a42daceb
Fix typo user.display_name -> user.name.
2018-04-10 16:44:34 -07:00
e6b7ed739b
Integrate with Pushshift.io to restore timesearch.
...
And improve commentaugment.
2018-04-09 19:53:53 -07:00
0267f221f0
Move t3_prefix to a helper function.
2018-04-07 20:05:31 -07:00
c7dd46d6ec
Add tables submission_edits, comment_edits. Somewhat experimental.
...
But as search API reaches EOL anyway it should be fine.
2018-03-22 17:08:57 -07:00
5eccfb18af
Allow a single Livestream instance to work on multiple subs.
...
-r subreddit1+subreddit2 -u user1+user2 will manage multiple
independent livestream generators and print the results for all.
2018-03-22 17:06:07 -07:00
fe7d5534e8
Oops, allow specific_submission to suppress -r -u requirement.
2018-03-22 16:26:27 -07:00
394aa6ec16
Print the migrate query before taking a count.
2018-03-22 16:25:49 -07:00
5d1c2f885d
When logging in, reassign the common.r instance.
2018-03-15 19:05:10 -07:00
0ec6002cba
Add critical notice.
2018-01-29 19:00:43 -08:00
c185ddaf77
Support usage of filepaths as -r and -u arguments.
...
Add `tsdb.name_from_path` so that if the user provides a filepath
as the -r or -u option, we can load their database from that
path and also figure out the subreddit / username to fetch the
subreddit / user object properly, without having to add another
cmd arg for specifying a nonstandard path. New constructor argument
fix_name to perform this automatically and return a tuple of
(database, fixed name).
2017-12-13 14:42:56 -08:00
278923a000
Add the NotExclusive exception and common.is_xor.
2017-12-13 14:35:36 -08:00
8b98224465
Add the DatabaseOutOfDate exception instead of using ValueError.
2017-12-13 14:22:23 -08:00
b7fcad7cc1
Start exception hierarchy; rename DBNotFound to DatabaseNotFound.
2017-12-13 14:07:52 -08:00
Ethan Dalool