Batch calculation of hds in VectorSpace
andrewcsmith opened this issue · comments
This line seems to be the thing that gives the OOM error during the VectorSpace initialization. It would be nice to batch these calculations to some maximum size.
Narrowed it down to this line.
If instead of gathering all of them at once, we gather them in batches and filter by max harmonic distance, that could allow for not hitting an OOM error.