microsoft / aici

AICI: Prompts as (Wasm) Programs

GPU acceleration on mac M1

mmoskal opened this issue 6 months ago · comments

Michał Moskal commented 6 months ago

add command line flag to specify how many layers to offload to GPU
verify that it works on M1