TODO: Improve Anemon Class in Relation to the Generator
taufik-nurrohman opened this issue · comments
Future anemon class must be able to accept input in the form of Generator and still maintain their shape without having to convert them into ordinary array before doing any data manipulation. Current version still need to convert the generator into an ordinary array before doing the manipulation, for example, to divide the array into chunks. If the array size is very large, this might affect the memory used for each page request.
Files and Pages class are two example class that inherited from this class. The number of files in the folder will greatly affect the existing performance.
Currently not achieveable because we need to make sure that generator is always available even after the next iteration is done.
About 576 pages in queue here and still no sensible drops in performance. No caching mechanism. Just regular file system iterator.