response limited to 14000 rows
matreyes opened this issue · comments
Hi!
According to https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/query the requests are limited to a page.
So when I try to process 500.000 rows, the count is correct, but the rows are only 14.000
I would recommend to respond with a Stream.resource/3 to call the job again if we are requesting for more rows (pages), but I'm not sure if the Table protocol allows a Stream instead of List.
I believe it supports any enumerable. Can you please try out a PR? Thank you!