Giters
airockchip
/
rknn-llm
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
258
Watchers:
7
Issues:
78
Forks:
26
airockchip/rknn-llm Issues
新手求助:如何更新NPU内核版本至0.9.6
Updated
2 days ago
Comments count
2
support qwen2-7b?
Updated
2 days ago
Comments count
1
这个项目有支持多模态大模型的计划吗?比如MiniCPM-V_2.5
Updated
5 days ago
Comments count
3
RKLLM支持多模态视觉大模型的转换吗
Closed
5 days ago
Consider Open-Sourcing the Code After Nearly Two Months Without Updates 项目近两个月未更新,建议开源代码
Updated
6 days ago
Comments count
5
如何接入anythingllm或fastgpt
Updated
6 days ago
recommend rkllm_run interface include a version that can directly accept embeddings.,建议rkllm_run接口有能直接接受embedding的版本
Updated
7 days ago
运行test.py报错
Updated
9 days ago
Error compiling kernel
Updated
15 days ago
为什么RKLLMResult *result, result -> num. 这个参数没给赋值啊,我想测一下每秒生成多少tokens,应该怎么做?
Updated
16 days ago
Comments count
1
Support RK3566?
Updated
16 days ago
在板子上跑server的demo,跑不起来,帮看下什么原因
Updated
20 days ago
Comments count
6
How to adapt the RWKV LLM?
Updated
22 days ago
Cannot find the clImportMemoryARM
Closed
a month ago
Comments count
1
ERROR: modpost: "iommu_get_dma_cookie" [drivers/rknpu/rknpu.ko] undefined!
Updated
a month ago
Comments count
2
Error: iommu_context->weight_memory is NULL
Updated
a month ago
Embeddings generation not supported?
Updated
a month ago
RKNN: [22:16:52.189] failed to convert handle(1020) to fd, ret: -1, errno: 24, errstr: Too many open files
Closed
a month ago
Comments count
2
可以支持多模态么
Closed
a month ago
Comments count
3
跑大模型遇到问题
Closed
a month ago
Comments count
1
是否支持 rk3582
Updated
a month ago
Comments count
2
internlm2_rkLLM对话效果不好
Updated
a month ago
Comments count
2
qwen-1.8b模型对话结果不好
Updated
a month ago
hi where is the code to download this?
Closed
a month ago
Comments count
1
internlm2-chat-1_8b模型转换出错
Updated
a month ago
Instructions?
Updated
a month ago
how to uninstall the rkllm latest (1.0.1) to install the old one (1.0.0)
Updated
2 months ago
Comments count
1
是否支持自定义rkllm的模型量化?
Closed
2 months ago
Comments count
3
兼容openai格式的接口
Updated
2 months ago
Comments count
1
Specific Token Appeared in Response
Updated
2 months ago
Phi3 推理无法结束或在最后出现无效输出
Closed
2 months ago
Comments count
2
转化模型时出错
Closed
2 months ago
输出全是: !!!!!!! 。这样的
Updated
2 months ago
Phi-3 error
Updated
2 months ago
Comments count
10
Procedure and Model Validation(程序和模型验证)
Updated
2 months ago
LLM models have bad output
Updated
2 months ago
Comments count
9
phi3 load error in rkllm1.0.1
Closed
2 months ago
Comments count
9
rkllm_init error in rkllm1.0.1
Closed
2 months ago
Comments count
2
将来是否会支持 moe 模型
Updated
2 months ago
E RKNN: [00:13:05.159] failed to convert handle(1020) to fd, ret: -1, errno: 24, errstr: Too many open files
Closed
2 months ago
Comments count
1
Need a way to stop inference midway
Closed
2 months ago
Comments count
1
flask_server.py DEMO无法正常执行
Closed
2 months ago
Comments count
7
Let's talk about converting and runtime 我们来谈谈转换和运行时
Updated
2 months ago
Qwen1.5-0.5B模型两次回答不一致
Updated
2 months ago
Comments count
10
rkllm1.0.1 总是激活3个core
Updated
2 months ago
模型转换内存需求过大
Updated
2 months ago
Comments count
6
rknn_init failed
Updated
2 months ago
Comments count
1
Open Source SDK
Closed
2 months ago
模型可视化、推理性能评估
Updated
2 months ago
Is the performance bottleneck of rknn llm in the CPU?
Updated
3 months ago
Comments count
4
Previous
Next