Engines not loading with text size larger than 75
Saniel0 opened this issue · comments
I found some old thread about this issue, but from what I found that should have been fixed. Is this still known issue or is there something wrong on my side
Happens for me as well. If token count is >75, it's still profile 0 (default engine) being used. The shell is cluttered with:
Error Code 3: API Usage Error (Parameter check failed at: runtime/api
executionContext.cpp::nvinfer1::rt::ExecutionContext::validateInputBindings::2045, condition: profileMaxDims.d[i] >=
dimensions.d[i]. Supplied binding dimension [2,154,2048] for bindings[2] exceed min ~ max range at index 1, maximum
dimension in profile is 77, minimum dimension in profile is 77, but supplied dimension is 154.