github/supysonic
1
0
Fork 0
mirror of https://github.com/spl0k/supysonic.git synced 2024-09-20 11:21:03 +00:00
Code Issues Releases Wiki Activity
693 Commits 6 Branches 17 Tags 3.1 MiB
8f5a9a3b73
Commit Graph

154 Commits

Author SHA1 Message Date
spl0k
db2799ef7e Reworked how the watcher is started 2019-03-31 18:06:45 +02:00
spl0k
270fa9883b Removing executable flag from files that shouldn't have it 2019-03-31 16:37:56 +02:00
spl0k
780c96c404 Fixed issues with float bitrate and empty tags 
Thanks to @nextfullstorm
Closes #139
 2019-03-23 17:08:46 +01:00
spl0k
e2cc51a0f0 Fixed issues when the watcher is set to log to /dev/null 2019-03-23 16:20:19 +01:00
spl0k
5367f068e1 Giving credit where credit is due 2019-02-09 16:19:30 +01:00
spl0k
cf846e88ee Merge remote-tracking branch 'pR0Ps/feature/transcode-cache' 2019-02-09 15:49:30 +01:00
spl0k
d7bbbfe383 Added test case for #133 2019-02-09 15:39:58 +01:00
Carey Metcalfe
0ac2376e07 Fix issues with hanging transcoding processes 
When a connection that is consuming a generated response is closed,
Flask closes the generator making it raise the special `GeneratorExit`
exception when the program tries to yield from it again. Because the
`transcode` function was called (returning a generator) before being
passed into `set_generated`, the exception was being handled in the
wrong order.

By passing the `transcode` function to `set_generated` and letting
`set_transcode` call it to return a generator while generating the
response for the client, the exception properly bubbles up through
`transcode` into `set_generated`. This allows both of them to handle it
properly by stopping the subproceses and not caching the incomplete
response data respectively.
 2019-02-03 23:23:00 -05:00
Carey Metcalfe
f106923f17 Remove unused 'Cache.protect' method 2019-02-03 22:56:03 -05:00
Carey Metcalfe
65d49a04c9 Implement a cache manager for album art and transcodes 
Quick summary
-------------
- Adds a Cache class (plus tests for it) that provides an API for
  managing a cache of files on disk
- Adds two new settings to the configuration file: `cache_size` (default
  512MB) and `transcode_cache_size` (default 1GB).
- Creates two cache managers using the settings above: one for general
  stuff (currently album art) and one for transcodes
- Adds the caching of transcoded files to disk for future use
- Modifies the existing image caching to use the cache manager

Longer explanations and justifications
--------------------------------------
The reason I separated out transcodes into an entirely separate cache is
that I could imagine a single transcode pushing out a ton of smaller
images or other cached content. By separating them it should reduce the
number of deletes caused by adding something to the cache.

The cache manager allows for caching a value from a generator via
passthrough. This means that a generator can be transparently wrapped to
save its output in the cache. The bytes from the generator will be
written to a temp file in the cache and yielded back. When it completes,
the temp file will be renamed according to the provided cache key. This
is how caching transcoded music is implemented.

If multiple generators for the same key are started, they will all write
to individual temp files until they complete and race to overwrite each
other. Since the key should uniquely represent the content it indexes
the files will be identical so overwriting them is harmless.

The cache will store everything for a minimum amount of time
(configurable, default is set at 5 minutes). After this time has
elapsed, the data can be deleted to free up space. This minimum is so
that when you cache a file to the disk you can expect it to be there
after, even if another large file is added to the cache and requests
that some files are deleted to make space.

To ensure that a file will not be paged out of the cache regardless of
the minimum time, there is a `protect` context manager that will refuse
the delete the key from the cache as long as it's active.

The cache has a maximum size, however this is more of a recommendation
as opposed to a hard limit. The actual size will frequently exceed the
limit temporarily until something can be paged out.
 2019-01-19 15:37:08 -05:00
spl0k
3b6186ebfc JSON: '_value_' -> 'value' 
Closes #136
 2019-01-19 15:04:56 +01:00
spl0k
7cfd958eeb Skip lyrics tests if ChartLyrics is down 2019-01-13 17:26:00 +01:00
spl0k
25c5c8277e Add support for downloadong folders and albums 
Ref #131
 2019-01-13 17:18:27 +01:00
spl0k
ac306f2725 Added method to list genres 2018-12-08 17:18:58 +01:00
spl0k
b195aca12f watcher: log to stderr when no logfile is set 2018-11-11 19:29:58 +01:00
spl0k
f5bab00a1c Small touches on logging 
Most notably not relying in Flask's logger, as this cause issues
at the end of tests on Python 2.7
Fixes #96
 2018-11-11 18:58:46 +01:00
spl0k
8132e38d46 Delete track dependents before tracks on folder deletion 
Fixes #129
 2018-11-01 14:02:12 +01:00
Taizo Simpson
066658f167
Consider embeded art when serializing albums, add relevant test 2018-10-12 19:07:48 -04:00
Taizo Simpson
2c4ec6c0e8
Whether or not a track has embeded art is tracked just like any other metadata, to reduce disk r/w and mem usage and a lot of other things. 
WARNING: This needs migrations before being merged to master
 2018-10-10 12:59:20 -04:00
Taizo Simpson
f43fecaf34
Added tests for reporting embeded cover art in folders and tracks 2018-10-09 13:04:17 -04:00
Taizo Simpson
a2add86550
Added tests for flac and ogg 2018-10-08 21:19:22 -04:00
Taizo Simpson
4bbcbd0acf
Art extraction is now done as a method of Track; cover_art() only extracts cover art if given a track ID; Cache embeded art 2018-10-08 20:05:45 -04:00
Taizo Simpson
29e462e0b8
Added test case for embeded album art 2018-10-08 15:30:38 -04:00
spl0k
0f1a31e677 Fixed test 2018-09-15 16:11:17 +02:00
spl0k
5a065c75ae Merge branch 'master' into db-setup 2018-09-15 16:04:43 +02:00
spl0k
1a15b95155 Merge branch 'master' into issue90 2018-09-08 15:37:08 +02:00
spl0k
dbf817ea9e Automatically create DB tables if needed 2018-08-29 14:56:28 +02:00
spl0k
9c58b695ff Watcher now handles cover art 
Closes #92
 2018-08-28 17:44:32 +02:00
spl0k
38f718b4df Using new pony on_connect decorator 
Revert "Restore SQLite case insensitive LIKE"
This reverts commit a08689e8c0.
 2018-08-11 16:16:34 +02:00
spl0k
a08689e8c0 Restore SQLite case insensitive LIKE 
See ponyorm/pony#367
 2018-08-05 15:35:29 +02:00
spl0k
78cf84e136 Remove invalid folders before scanning for covers 
Fixes #101
 2018-06-24 13:19:04 +02:00
spl0k
405a26a20a Don't restrict cover art to 'cover.jpg' files 
Ref #81
 2018-05-21 16:16:06 +02:00
spl0k
2b1977892e Generate a secret key only once 2018-04-01 12:32:36 +02:00
spl0k
921e4c7c30 Fixed playlists tests 2018-03-22 19:18:28 +01:00
spl0k
6ac969e2c5 Index folder and track path 
Speeds up scanning
 2018-03-17 23:25:26 +01:00
spl0k
b72daea109 Improved folder deletion 2018-03-15 20:50:01 +01:00
spl0k
9eb1bf63d7 API: stream.view: added support for 'estimateContentLength' 2018-03-10 23:04:57 +01:00
spl0k
a6b894c586 API: marked explicitly unsupported methods/parameters as such 2018-03-10 22:15:40 +01:00
spl0k
adb4e7e89b API: improved client preference passing 2018-03-10 18:35:00 +01:00
spl0k
0988d4319e Unified file headers 2018-03-04 21:49:56 +01:00
spl0k
4cbc8765e0 Refactored FolderManager to raise exceptions 
rather than returning status codes
 2018-03-04 17:36:35 +01:00
spl0k
ef9e7af026 Refactored UserManager to raise exceptions 
rather than returning status codes
 2018-03-02 22:51:49 +01:00
spl0k
58b8a1171a More error refactoring 2018-02-25 22:28:47 +01:00
spl0k
177b0cce0d Refactoring API error handling 2018-02-25 11:39:26 +01:00
spl0k
86892f375d Reenabled skipped tests 2018-02-18 16:51:05 +01:00
spl0k
005ae4803b More formatter refactoring 2018-02-11 12:40:10 +01:00
spl0k
66b6eb341e Tests: removed context/module unload dance 
Was a workaround for issues fixed by blueprints
 2018-01-29 22:09:28 +01:00
spl0k
b33e8ae6d1 Set mimetype when creating the response, don't try to fix it afterwards 
Ref #76
 2018-01-27 15:18:44 +01:00
spl0k
8275966db0 Dropped simplejson dependency 
Ref #79
 2018-01-21 22:02:32 +01:00
spl0k
c6992a4726 Fixed reading malformed tags 
Fixes #86
 2018-01-21 14:42:27 +01:00
spl0k
954c75bc35 Ignore files with a badly encoded path 
Closes #85
 2018-01-20 18:26:58 +01:00
spl0k
fd67eb9cd4 Fixed DeprecationWarnings 2018-01-16 23:16:13 +01:00
spl0k
420003dfc1 Py3: fixed remaining errors (hidden due to skipped tests) 
Ref #75
 2018-01-16 22:19:24 +01:00
spl0k
7edb246b1e Py3: str/bytes, iterators, etc. 
It seems to work on Python 3 now!
Ref #75
 2018-01-11 23:08:53 +01:00
spl0k
1a79fe3d70 Py3: basestring 
Ref #75
 2018-01-08 23:13:50 +01:00
spl0k
8674965c03 Read config files without interpolation 
Fixes #84
 2018-01-08 19:17:00 +01:00
spl0k
1605fcd202 Py3: imports, exceptions, dicts 
Ref #75
 2018-01-06 00:33:45 +01:00
spl0k
df63919634 Look at my pony, my pony is amazing 2017-12-23 22:59:04 +01:00
spl0k
53fd4865cb Get on my pony 2017-12-21 23:29:00 +01:00
spl0k
6daedc6919 I'm on a pony 2017-12-19 23:16:55 +01:00
spl0k
2428ffeb57 Scanner, CLI and watcher are on a pony 2017-12-17 23:25:34 +01:00
spl0k
a4b9a97271 All managers get a pony 2017-12-16 17:42:53 +01:00
spl0k
6bd61e0388 Getting out of the storm on a pony 2017-12-16 13:53:43 +01:00
spl0k
8046457661 Relative imports 2017-12-12 22:24:18 +01:00
spl0k
5d969e4c71 LastFM "test" 2017-12-10 18:48:23 +01:00
spl0k
daf34271b4 IniConfig tests 2017-12-10 18:48:08 +01:00
spl0k
332fd0446f CLI basic tests 2017-12-10 17:53:02 +01:00
spl0k
0a47ef89a5 CLI: fixed foreign key errors on user deletion 2017-12-10 15:11:50 +01:00
spl0k
4a99e52caa Added (skipped) transcoding tests 2017-12-07 23:33:32 +01:00
spl0k
8813cbd326 More watcher tests 2017-12-06 23:19:16 +01:00
spl0k
f63a9ed4cc First steps of a watcher test suite 2017-12-05 23:18:39 +01:00
spl0k
2ea7224815 Fixed tests init 2017-12-05 09:11:53 +01:00
spl0k
5d23b38bf3 Tests use a temporary cache directory 2017-11-27 22:55:18 +01:00
spl0k
9ffe40aa2c Reactivated config-dependent test 2017-11-27 22:46:09 +01:00
spl0k
a62976ba9d Reworked config handling 2017-11-27 22:30:13 +01:00
spl0k
4ca48fd31c Testing the scanner 2017-11-25 22:21:58 +01:00
spl0k
d88a1b6d0b Web UI user section tests 2017-11-24 19:24:58 +01:00
spl0k
b998bb0684 Web UI: reworked how data is passed to templates 
Logged user is pushed in request data
No more 'username' session key
Small fixes along the way
 2017-11-22 22:07:06 +01:00
spl0k
9a58d067ab Added playlists management tests 2017-11-20 21:33:38 +01:00
spl0k
79613aed84 Increased managers tests coverage 2017-11-20 21:32:35 +01:00
spl0k
be47a259a8 Added folder management UI tests 2017-11-19 17:49:31 +01:00
spl0k
2cf6d01489 Test architecture unifying 2017-11-17 23:26:25 +01:00
spl0k
74ce600e03 Updated getMusicFolders test 2017-11-17 20:00:26 +01:00
spl0k
fd52a04535 Media retrieval (minus transcoding) tests 2017-11-17 19:56:14 +01:00
spl0k
1cf44d1d1d star/unstar/rating/scrobble tests 
The `scrobble` test is skipped, it passes but causes some weird
error on exit.
 2017-11-14 23:19:54 +01:00
spl0k
5084c745dc Listing endpoints tests 2017-11-11 00:13:18 +01:00
spl0k
27bd7bce0c Added playlist tests 2017-11-08 23:21:52 +01:00
spl0k
6f713e12db Added tests for search and chat 2017-11-03 23:15:48 +01:00
spl0k
d19886fafa Rewritten and improved existing tests 2017-11-01 20:55:35 +01:00
spl0k
8a14ef496d Added tests on API auth, format and such 2017-10-29 16:08:00 +01:00
spl0k
8f5fcc82f5 Response formatting tests 2017-10-28 21:18:34 +02:00
spl0k
955a678df3 Improved existing managers tests 2017-10-28 15:54:41 +02:00
spl0k
fa4b1eca84 A bit of sorting 2017-10-28 11:42:46 +02:00
spl0k
ea8d2baa14 More data model tests 2017-10-27 21:42:36 +02:00
spl0k
ba70d0aadb Renamed test module 2017-10-26 23:17:37 +02:00
spl0k
b04c23ea77 More tests 2017-10-26 23:16:20 +02:00
spl0k
4c6cb99833 Adding some tests... 2017-10-26 21:52:13 +02:00
Óscar García Amor
09ce5ae455 Update tests to check UTF-8 passwords 2017-08-07 14:37:05 +02:00
Óscar García Amor
d9d90ffacf Retab and change header to frontend __init__.py 2017-08-07 13:10:06 +02:00
Óscar García Amor
f8254532ed WIP: Added unit tests for API and frontend 2017-07-14 20:57:08 +02:00