3869e5a99a
Use the same print format for get_submissions and get_comments.
2020-10-08 13:15:05 -07:00
b412b5fd98
Move contents of ts_modules/__init__.py to timesearch.py.
...
I realized that this two-layer launch was unnecessary.
2020-10-08 13:12:57 -07:00
741f47d0b9
Use betterhelp.subparser_main instead of decorator.
...
To get the parser off the global.
2020-10-07 00:32:44 -07:00
c27f8038c7
Use pathclass.Path.makedirs.
2020-09-24 14:19:10 -07:00
3373e36f64
Use pathclass.Path.open.
2020-09-20 18:30:13 -07:00
0bd52eb08b
Bump version to 2020.09.06.0.
2020-09-06 21:44:07 -07:00
eba495e3b7
Increase size of chunks going into db to reduce commit frequency.
2020-09-06 21:43:48 -07:00
5adc0943aa
Use pushshift's /meta endpoint to discover ratelimit.
2020-09-06 21:42:30 -07:00
e136aeea4e
Log the size of received batches from pushshift.
2020-09-06 21:41:44 -07:00
83d5a8e70e
Fix retry loop not breaking after successful try!
2020-09-06 21:31:46 -07:00
4a61d820b3
Add skewer-case aliases for snake_case arguments.
2020-08-12 10:24:31 -07:00
1132c0aee1
Remove unnecessary import requests from merge_db.
2020-05-21 22:30:12 -07:00
10699893ea
Allow get_comments to create the database.
...
This was false because prior to Pushshift, commentaugment worked by
reading the comments tree on every submission, and thus couldn't be
done first. Now, I think there's nothing wrong with getting comments
before submissions.
2020-05-12 18:19:46 -07:00
a56451108d
Add docstring to top of main timesearch.py launch file.
2020-04-22 23:53:04 -07:00
b98f096fd4
Replace "> timesearch.py" with "python timesearch.py"
...
The bracket was meant to look like the command prompt, but for
linux users they would be more used to $ or #, and for people who
do not use the command line often they may be confused by it
altogether. This change should help make it a little more clear as
to what's going on.
2020-04-22 23:25:42 -07:00
30f0fed6c3
Oops, get_submissions block on readme still said timesearch.
2020-03-06 11:35:19 -08:00
45f6e36fad
Add some whitespace between these parts of the help summary.
2020-02-08 21:10:48 -08:00
d64571944f
main should return args.func(args) value.
2020-02-08 17:23:27 -08:00
d027cce562
main should return args.func(args) value.
2020-02-08 16:20:19 -08:00
263232e0a0
I keep forgetting I have a version number.
2020-02-08 15:51:59 -08:00
dd38e0c8da
Print a helpful message when bot.py or bot4.py isn't found.
2020-02-08 15:51:45 -08:00
5345e8f4fc
Use betterhelp to manage docstrings, aliases, and helptexts.
2020-01-30 23:25:24 -08:00
a151edd549
Use new svg logo on readme.
2020-01-28 08:31:44 -08:00
bc2addd7be
Refer to get_comments instead of commentaugment.
2020-01-27 20:16:51 -08:00
31296000f9
Alphabetize & organize helptexts with new names.
2020-01-27 20:13:01 -08:00
02b2dc166e
Fix docstring incorrectly referring to constants.
2020-01-27 20:09:02 -08:00
24f155a40d
Update OutOfDate message to show actual argument.
2020-01-27 20:00:08 -08:00
d12e66f19c
DB v2. Rename redmash folder to index.
2020-01-27 19:53:27 -08:00
0ef423d780
Create _first_time_setup, _load_pragmas, and _check_version.
2020-01-27 19:51:23 -08:00
d982d64071
Update readme.
2020-01-27 19:23:50 -08:00
ecfb96820c
Correct index helptext to say index instead of mash.
2020-01-27 19:21:41 -08:00
4e74d4be6e
Update license to 2020.
2020-01-27 19:02:32 -08:00
698e3820e8
Delete gitattributes.
...
I must have added it back when I was committing .db files
to github but no need for that any more.
2020-01-27 19:01:54 -08:00
f577cff9a0
Delete all this templated junk out of gitignore.
2020-01-27 19:01:05 -08:00
9016292bde
Delete the 20180409 html file, it's on my .io page anyway.
2020-01-27 18:59:47 -08:00
19bd53115e
Fix reference to new name timesearch_modules.
2020-01-27 18:58:04 -08:00
1fb281bf7f
Rename mergedb.py -> merge_db.py.
2020-01-27 18:57:06 -08:00
d2220a3ced
Rename getwiki.py -> get_wiki.py.
2020-01-27 18:54:04 -08:00
6b0dd55431
Rename getstyles.py -> get_styles.py.
2020-01-27 18:53:19 -08:00
2022db2b0c
Rename redmash.py -> index.py.
2020-01-27 18:45:36 -08:00
744dadd3ee
Rename commentaugment.py -> get_comments.py.
2020-01-27 18:41:58 -08:00
75648343e2
Rename timesearch.py -> get_submissions.py.
2020-01-27 18:39:54 -08:00
b3db322a78
Rename timesearch directory -> timesearch_modules.
...
This marks the first in a long series of rename commits.
Hold on to your databases!
2020-01-27 18:32:05 -08:00
28216c76e1
Add timesearch_logo.svg.
2020-01-19 10:58:20 -08:00
2e2da2b816
Bump version number.
...
To date of the last commits.
2020-01-11 20:30:08 -08:00
43ce535b4f
Add argument --offline to redmash, points to offline_reading files.
...
Previously, the files generated by offline_reading were difficult
to use because there was no index file and the filenames are just ids.
So now, the redmash can act as an index!
2020-01-05 20:51:31 -08:00
20c827566f
Use DBEntry in redmash to get rid of all this column junk.
2020-01-05 20:40:52 -08:00
f2f1db6bc9
Move the DBEntry class to tsdb.
2020-01-05 20:35:15 -08:00
15009a3409
Refer to this as link instead of shortlink specifically.
...
Stay tuned to see why!
2020-01-05 20:25:35 -08:00
ceb66c772a
Separate the generating of html from the writing it.
...
I was not happy with the fact that html_from_database actually
performed the file writes. Furthermore the other tool modules have
a titular function that performs the most main task but this one
didn't, it was hidden inside this function. So let's make
html_from_database just a generator and have a function
offline_reading that does what you came here to do.
2020-01-05 20:07:33 -08:00
Ethan Dalool