concurrency with batches of blocks
joshstevens19 opened this issue · comments
Right now on big block ranges, it loops through block by block to get the log information, with this block 2 will not be checked until block 1 has been checked; we should do some work to split up the range and run many tasks at once editing the from and to, we could just do this in the main.rs and keep the rest of the code as it is
have done this change local not super happy with it yet tbh but it does give a 20% speed increase awaiting my reth provider PR to be merged so i can get the provider in first then il come back to this