1
0
mirror of https://github.com/spl0k/supysonic.git synced 2024-12-23 01:16:18 +00:00
supysonic/tests/base
Carey Metcalfe 65d49a04c9 Implement a cache manager for album art and transcodes
Quick summary
-------------
- Adds a Cache class (plus tests for it) that provides an API for
  managing a cache of files on disk
- Adds two new settings to the configuration file: `cache_size` (default
  512MB) and `transcode_cache_size` (default 1GB).
- Creates two cache managers using the settings above: one for general
  stuff (currently album art) and one for transcodes
- Adds the caching of transcoded files to disk for future use
- Modifies the existing image caching to use the cache manager

Longer explanations and justifications
--------------------------------------
The reason I separated out transcodes into an entirely separate cache is
that I could imagine a single transcode pushing out a ton of smaller
images or other cached content. By separating them it should reduce the
number of deletes caused by adding something to the cache.

The cache manager allows for caching a value from a generator via
passthrough. This means that a generator can be transparently wrapped to
save its output in the cache. The bytes from the generator will be
written to a temp file in the cache and yielded back. When it completes,
the temp file will be renamed according to the provided cache key. This
is how caching transcoded music is implemented.

If multiple generators for the same key are started, they will all write
to individual temp files until they complete and race to overwrite each
other. Since the key should uniquely represent the content it indexes
the files will be identical so overwriting them is harmless.

The cache will store everything for a minimum amount of time
(configurable, default is set at 5 minutes). After this time has
elapsed, the data can be deleted to free up space. This minimum is so
that when you cache a file to the disk you can expect it to be there
after, even if another large file is added to the cache and requests
that some files are deleted to make space.

To ensure that a file will not be paged out of the cache regardless of
the minimum time, there is a `protect` context manager that will refuse
the delete the key from the cache as long as it's active.

The cache has a maximum size, however this is more of a recommendation
as opposed to a hard limit. The actual size will frequently exceed the
limit temporarily until something can be paged out.
2019-01-19 15:37:08 -05:00
..
__init__.py Implement a cache manager for album art and transcodes 2019-01-19 15:37:08 -05:00
test_cache.py Implement a cache manager for album art and transcodes 2019-01-19 15:37:08 -05:00
test_cli.py Automatically create DB tables if needed 2018-08-29 14:56:28 +02:00
test_config.py Unified file headers 2018-03-04 21:49:56 +01:00
test_db.py Consider embeded art when serializing albums, add relevant test 2018-10-12 19:07:48 -04:00
test_lastfm.py Small touches on logging 2018-11-11 18:58:46 +01:00
test_scanner.py Added tests for flac and ogg 2018-10-08 21:19:22 -04:00
test_secret.py Fixed test 2018-09-15 16:11:17 +02:00
test_watcher.py watcher: log to stderr when no logfile is set 2018-11-11 19:29:58 +01:00