Commit graph

493 commits

Author SHA1 Message Date
8b4202fe87
Always use urandom in all functions. Remove --urandom option. 2022-01-09 17:05:03 -08:00
d34103917f
Re-add the normalize_sep function, but more conservative.
Formerly I was normalizing backslash to forwardslash on unix, which is
bad. Then I removed the function because I thought normpath was the
right tool for the job. Now I'm finding a few situations I just want to
norm the sep again.
2022-01-09 16:59:09 -08:00
4b8ae01786
Add starting_balance parameter, and by default make it nonzero. 2022-01-09 16:55:53 -08:00
e5114ecf2c
Alphabetize docstring. 2022-01-09 16:55:15 -08:00
c914d4236e
Make only_shrink a keyword-only argument. 2022-01-09 16:54:15 -08:00
c1886ba536
Add OVERWRITE_ sentinels for different overwrite techniques. 2022-01-04 13:07:16 -08:00
31156aa67c
Sort scandir entries.
In spinal.walk sorting is optional because there I prioritize
configurability and speed, but for pathclass.walk I think it
makes sense to prioritize comfort and just-works results.
2022-01-04 12:47:17 -08:00
d3d5bd1fa2
Add base mutable class. 2021-12-27 22:33:18 -08:00
10a312b996
Add return value written_files. 2021-12-27 17:08:54 -08:00
8d9416cb2f
Bump to version 0.0.71. 2021-12-23 17:08:34 -08:00
373d8dd36d
Improve operatornotify betterhelp epilogue. 2021-12-23 17:07:36 -08:00
90a7c4b76a
Add "or" to the title_capitalize lowercase list. 2021-12-23 17:07:22 -08:00
597705fc57
Add hms_letters functions to make 00h00m00s outputs. 2021-12-21 17:09:40 -08:00
9381c2c9c7
Also log commits without user-given messages. 2021-12-21 17:02:26 -08:00
28b4c8626b
Fix ratelimiter reject mode always subtracting balance. 2021-12-21 17:02:08 -08:00
0a0bbae88c
Use unicode_width instead of len, improve in_box. 2021-12-20 16:45:47 -08:00
ca4b78c654
Add stringtools.unicode_width. 2021-12-20 16:44:10 -08:00
a73263f27d
Log absolute_path instead of the Path object. 2021-12-20 16:43:14 -08:00
359c255817
Make pathclass globs faster by checking scandir for stat first. 2021-12-16 21:14:35 -08:00
c2dae46c99
Update interactive.py. 2021-12-14 20:37:40 -08:00
90f14e04f8
Improve a few uses of pathclass. 2021-12-07 12:41:58 -08:00
f2190b9bfb
Add Path.walk_directories, walk_files. 2021-12-07 12:41:35 -08:00
23fe4d1d1e
Call path.assert_is_directory before walking. 2021-12-02 19:32:39 -08:00
19afbc2105
Enforce with_child basename is str. 2021-12-02 19:32:25 -08:00
e2fd04ccf1
Remove .absolute_path thanks to fspath. 2021-12-02 19:32:08 -08:00
b288cca519
Rewrite a lot of pathclass, spinal.walk using tuple-based Path.
I was inspired by the idea of "making impossible states impossible"
and using a data model that accurately represents what we intend for
it to represent. Instead of storing the path as a string where "it's
a string but actually you're supposed to know that the parts between
os.seps are different parts and the first one is special and...", we
can use a data model that directly says that. Storing the path as a
tuple of (Drive, Part, Part) helps me focus on the semantics of the
Path as a collection of parts joined by the os.sep.

Furthermore, storing the path as a string made some operations slow.
Every time we call one of the os.path functions with a string, it
has to do a lot of normalization and edge-case handling even when we
know it wouldn't be needed. By storing the path as a tuple, we can
instantly get the drive name, parent dir name, and basename without
asking os.path to split it for us every single time. It also makes
relative path / common ancestor checks a lot easier to understand.
Fewer operations need to go into the slow functions.
2021-11-30 21:16:47 -08:00
7a48a7b69c
Let wait_for_internet take a backoff class to control sleeps. 2021-11-24 15:14:18 -08:00
bef06dac75
Add Pool.done, indicates all threads have completely finished. 2021-11-20 19:50:18 -08:00
9b8dd35658
Let Pool._threads be a set instead of list. 2021-11-20 19:48:12 -08:00
305c6bfdf4
Add lock around running_count increment, decrement.
I thought these assignments were atomic for int but they're not.
2021-11-20 19:48:12 -08:00
cca488bc7a
Move code to own function Pool.close. 2021-11-20 19:48:12 -08:00
87392b31a3
Add some type annotations. 2021-11-20 19:48:11 -08:00
dcd4d20b07
Rename PooledThread.start -> mainloop. 2021-11-20 19:20:39 -08:00
f1aea14646
Move the sleep out of the locked portion. 2021-11-20 18:53:56 -08:00
8f8a39eaca
Add Ratelimiter.__repr__. 2021-11-20 18:52:00 -08:00
6d8a406ceb
Use time.monotonic. 2021-11-20 18:51:46 -08:00
edeff079f7
Use vlogging. 2021-11-20 18:49:31 -08:00
8317e7c7b7
Add some docstrings. 2021-11-20 18:48:58 -08:00
6d9300aa9d
Remove task_done since we never call queue.join. 2021-11-20 18:48:40 -08:00
039ac45e17
Let Job.join accept a timeout. 2021-11-20 18:48:05 -08:00
f7250f8157
Let downloady take ratemeters to assist caller's reporting. 2021-11-20 18:46:20 -08:00
2fbe24b272
Add argument --operatornotify-subject to override subject line. 2021-11-18 19:53:54 -08:00
1c1bb49cb8
Add ----- between epilogues. 2021-11-18 17:06:00 -08:00
e995bd502d
Use os.path.normpath instead of normalize_sep. 2021-11-18 17:02:32 -08:00
f1b88b49fe
Raise typeerror if not Path or str, and dedent by early return. 2021-11-14 22:18:03 -08:00
3049a62bc0
Use httperrors. 2021-11-13 01:21:32 -08:00
ef546886c9
Use sock.settimeout instead of module setdefaulttimeout. 2021-11-13 01:20:42 -08:00
1bbb8bedee
Use voussoirkit.httperrors. 2021-11-13 01:20:26 -08:00
e8a0b0a050
Let get_external_ip take a timeout. 2021-11-13 01:20:13 -08:00
53756662ad
Disambiguate kwargs. 2021-11-11 18:17:42 -08:00