Add support for MLX (Apple Silicon)
abdulfatir opened this issue · comments
Should we add support for MLX? This would make inference faster for people with Apple Silicon Macs. Let's discuss.
Some discussion here: ml-explore/mlx-examples#589
cc @sugatoray
Happy to support you all here. We already have a T5 in MLX so that could serve as a good starting point https://github.com/ml-explore/mlx-examples/tree/main/t5
We would also gladly point people to this e.g. in our community projects page and elsewhere ml-explore/mlx#654
Added in a separate branch (PR #41 and #46): https://github.com/amazon-science/chronos-forecasting/tree/mlx
cc @awni @sugatoray
That's awesome!!
@abdulfatir That's great!