public-transport / gtfs-utils

Read & analyze GTFS datasets using Node.js.

Home Page:https://github.com/public-transport/gtfs-utils#gtfs-utils

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

sort.sh needs too much memory

derhuerst opened this issue · comments

Because of #27, I switched to Miller, but it just needs too much memory to sort the CSV files.

I aborted sorting stop_times.txt of the 2021-03-19 DELFI dataset after 1h and >12gb of memory usage.

Are there more efficient tools that can sort CSV files?