Document rechunking logic and clarify terminology
jbusecke opened this issue · comments
Splitting this out of the large #715 as a separate issue.
![image](https://private-user-images.githubusercontent.com/14314623/317065482-7374d98b-4273-47b0-97d9-6960a69c6f7b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjA2NzU0MTksIm5iZiI6MTcyMDY3NTExOSwicGF0aCI6Ii8xNDMxNDYyMy8zMTcwNjU0ODItNzM3NGQ5OGItNDI3My00N2IwLTk3ZDktNjk2MGE2OWM2ZjdiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzExVDA1MTgzOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWE5OWVlNzM4YzhhMGQyNzYxODcxN2FiYzhkYTI5ZDE5OGY1ZjIyNWI3ODMxMTRiZTdjY2UxMmQ5NzUxYTIzYzQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.lwBov2FePXT36jCY68bItaYaY_VL0tTE9xxMg91YQh0)
FWIW I think it would be helpful to keep working on a schematic like the one above and label the following terms in there:
- Files
- Fragments
- Sub-Fragments
- Groups (of fragments)
- Target chunks
I might have missed/double counted some terms, but having those enumerated might help with future debugging/refactoring.
Originally posted by @jbusecke in #715 (comment)