Commit graph

310 commits

Author SHA1 Message Date
Ethan Dalool
e334396d56 Add dotdict.py. 2020-02-19 13:11:26 -08:00
Ethan Dalool
b66a89268b Use sqlparse to strip comments before finding columns. 2020-02-19 13:06:57 -08:00
Ethan Dalool
f7e314f392 Replace some % formatters with fstrings. 2020-02-18 00:42:33 -08:00
Ethan Dalool
7c0f3979a4 Add a parent SpinalException class. 2020-02-18 00:23:57 -08:00
Ethan Dalool
ef89ba67c2 Rename hash_file's callback to callback_progress. 2020-02-18 00:20:51 -08:00
Ethan Dalool
edd2ee716b Split file hashing code into own function hash_file. 2020-02-18 00:17:38 -08:00
Ethan Dalool
1976ccb843 Let known_size checking of verify_hash be optional. 2020-02-18 00:09:15 -08:00
Ethan Dalool
df9b829346 Replace some % formatters with fstrings. 2020-02-18 00:06:26 -08:00
Ethan Dalool
807470b9a2 Remove spinal.is_subfolder function. Pathclass has in operator. 2020-02-17 23:50:05 -08:00
Ethan Dalool
7713e735cc Remove the version number from bytestring.
It used to be a separate module, now it's in voussoirkit.
2020-02-17 23:42:07 -08:00
Ethan Dalool
d3d4eae8f6 Improve ratelimiter docstrings. 2020-02-17 23:40:42 -08:00
Ethan Dalool
941b9b5350 Add a lock to make Ratelimiter thread-safe. 2020-02-17 23:39:43 -08:00
Ethan Dalool
9b8b0b6339 Replace else-if with elif. 2020-02-17 23:08:35 -08:00
Ethan Dalool
1d0f96a966 Fix typo succesful -> successful. 2020-02-17 23:01:15 -08:00
Ethan Dalool
e5b07cd72d Add some comments to pipeable. 2020-02-17 22:58:26 -08:00
Ethan Dalool
560b918815 Remove this unused argv function. 2020-02-17 22:57:20 -08:00
Ethan Dalool
267ae16c5d Add a parent PipeableException class. 2020-02-17 22:56:39 -08:00
Ethan Dalool
eb3698637f Use SystemExit instead of sys.exit, like my other programs. 2020-02-17 22:56:19 -08:00
Ethan Dalool
4890129360 Add argument stop_event to safely finish & quit a copy thread. 2020-02-15 18:00:09 -08:00
Ethan Dalool
64d0968040 Use with statement for _job_manager_lock. 2020-02-12 19:17:49 -08:00
Ethan Dalool
f6872e77cf Make job._joinme_lock private to discourage outside editing. 2020-02-12 19:12:12 -08:00
Ethan Dalool
bf5d621dd3 Make pool._job_manager_lock private to discourage outside editing. 2020-02-12 19:11:55 -08:00
Ethan Dalool
7041448c82 Make pool._jobs private to discourage outside editing. 2020-02-12 19:11:24 -08:00
Ethan Dalool
1921e62011 Add method add_many for batch creation of jobs. 2020-02-12 19:06:20 -08:00
Ethan Dalool
7de2833df9 Make the job's thread private and toss it after it's done. 2020-02-12 17:30:23 -08:00
Ethan Dalool
b7a2c3b19b Simplify pool.join logic by just calling each job's join. 2020-02-12 17:29:29 -08:00
Ethan Dalool
a1f26200fa Add the ability to pause the threadpool. 2020-02-12 16:56:07 -08:00
Ethan Dalool
630159768d Use slice assignment instead of list.remove for clearing jobs. 2020-02-12 16:53:52 -08:00
Ethan Dalool
87a3002351 Add threadpool.py. 2020-02-11 17:07:00 -08:00
Ethan Dalool
eef6bf5175 Add sentinel.py. 2020-02-11 17:06:42 -08:00
Ethan Dalool
2add4e4ec1 Add helper function september_now so you can skip the now() call.
Especially so outsiders don't have to write the long call
eternalseptember.september_string(eternalseptember.now(), ...) if
they don't have their own now function.
2020-02-11 17:06:35 -08:00
Ethan Dalool
beaa7a47e1 Rename this variable strftime -> strf. 2020-02-11 17:05:05 -08:00
Ethan Dalool
8a3e823a2e Update ifmain to my standard format. 2020-02-11 17:03:26 -08:00
Ethan Dalool
ba3dedd39a Bump to version 0.0.47. 2020-02-09 11:56:15 -08:00
Ethan Dalool
0e92201e06 Add getpermission.py. 2020-02-09 11:54:28 -08:00
Ethan Dalool
6691722e7c main should return args.func(args) value. 2020-02-08 17:19:54 -08:00
Ethan Dalool
90de78a57e Bump to version 0.0.46. 2020-02-07 15:15:07 -08:00
Ethan Dalool
87ab04abab Add support for parsers that can be used bare, no required args. 2020-02-07 12:33:46 -08:00
Ethan Dalool
abe73ae24d Add extract_table_column_map and reverse_table_column_map. 2020-02-06 20:18:42 -08:00
Ethan Dalool
593ff020dc Add docstring to hex_byte. 2020-02-06 20:18:09 -08:00
Ethan Dalool
6cac1d5a25 Show all missing columns when raising the missing error. 2020-02-06 20:17:49 -08:00
Ethan Dalool
8238481262 Fix == between two Extensions. 2020-02-06 11:52:18 -08:00
Ethan Dalool
a8ef6ca2c2 Bump to version 0.0.45. 2020-02-04 19:27:11 -08:00
Ethan Dalool
1707b40292 Add imagetools.py. 2020-02-04 19:26:12 -08:00
Ethan Dalool
98f716256c Bump to version 0.0.44. 2020-02-04 19:25:20 -08:00
Ethan Dalool
2dad632122 If one handle gets permissionerror, close other one before return. 2020-02-03 19:29:27 -08:00
Ethan Dalool
6a63454f62 Fix exclude_directories not being used because if yield_dirs. 2020-02-03 16:43:39 -08:00
Ethan Dalool
0cff7b8734 Fix directories yielded twice, once as current and once as child. 2020-02-01 16:20:40 -08:00
Ethan Dalool
0cb646fda0 Appease some flake8 linting. 2020-01-31 20:53:29 -08:00
Ethan Dalool
3ff49e1a44 Improve spinal performance with os.walk, sacrificing breadth first.
Previously, os.path.isdir was one of the biggest time sinks in spinal.
Switching from my custom code to os.walk, thanks to its use of scandir,
saves a lot of time. For searching my 2TB drive with a hot cache, time
shrank from 70s to 35s.
However, os.walk doesn't support breadth first search, so that's gone
unless I reimplement os.walk myself to support it.
2020-01-31 20:25:47 -08:00