Giters

tigros / Whisperer

Batch speech to text using OpenAI's whisper.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Whisperer not working

RickArcher108 opened this issue · comments

commented

I'm on a PC with a PowerColor Fighter AMD Radeon RX 6700 XT Gaming Graphics Card with 12GB GDDR6 Memory. 64-bit operating system, x64-based processor. Windows 11 Home.

I can't get Whisperer to work. Whisper Desktop works just fine. Using the large language model, it can transcribe a 2 hour audio in about 20 minutes. But I'd really like to be able to achieve batch processing.

I don't get an error message. About 6 hours ago I started a batch of 17 10-minute mp3s. Whisperer immediately made wav files out of them. The Go button changed to Cancel, But then nothing more has happened.

I don’t hear my GPU’s fan whirring, which usually happens with Whisper. Any suggestions?

commented

i wonder if you have an integrated GPU too? you're right the fans should be revving.
try running these commands from a cmd prompt:

reg query hklm\SYSTEM\CurrentControlSet\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318} /f 00* /k
reg query hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0000 /v HardwareInformation*
reg query hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0001 /v HardwareInformation*

please copy paste the results.

commented
commented

ok, let's check the other 2:

reg query hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0002 /v HardwareInformation*
reg query hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0003 /v HardwareInformation*
commented
commented

I see the problem. The NVidia card is removed right? Looks like software wasn't removed properly, google DDU for a tool to remove NVidia drivers.

A quicker way is to run:

reg delete hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0002 /v HardwareInformation.qwMemorySize

That would remove a single key in the registry related to the 1050 TI (memory size). It's a key whisperer is concerned about.

Then try whisperer again.

commented
commented

i just noticed you have HardwareInformation.AdapterString REG_BINARY ...

it's usually a string not REG_BINARY so that might break GPUmembyproc.exe

in cmd prompt cd to whisperer folder and run GPUmembyproc, is it blank?

what is @.***? that's in the srt file?

commented
commented

what folder whisperer in?

cd means change directory, so in cmd you type "cd /d thefolder" then GPUmembyproc

also make sure NVidia qwMemorySize is gone:

reg query hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0002 /v HardwareInformation.qwMemorySize

if it's still there

reg delete hklm\SYSTEM\ControlSet001\Control\Class\{4d36e968-e325-11ce-bfc1-08002be10318}\0002 /v HardwareInformation.qwMemorySize
commented
commented
commented

in cmd F:\Downloads\Whisperer type dir

please paste that.

commented
commented

seems you have an old version, get https://github.com/tigros/Whisperer/releases/download/2.8/Whisperer.zip

unzip replacing those files, try GPUmembyproc again.

commented
commented

ok good! strange GPUmembyproc was missing though since it's been there since day 1. I'm guessing YASA (yet another stupid antivirus) cheers!

commented
commented

ya Norton is one of the worst things you could put on a PC.

commented
commented

i don't use any, there's a program called dControl to turn off defender completely too. To test a file there's virustotal.com

if you don't trust yourself to not click crazy things, i guess i'd go with Windows defender, but seems to me very easy to avoid, then again i'm a long time programmer.

edit: actually what you really want is incremental C: drive backup, I use Macrium Reflect, as opposed to Norton, that's the best program you could put on a PC.

commented
commented

Do you mean only the VTT check box is checked and nothing? could be Norton, again. I don't see what else it could be.

commented
commented

you could just change the 10 at a time to 1 or 2, or change large model to small or base, they work pretty good and much faster.

commented
commented

you can change the max at once anytime, no problem. you might've stumbled on a problem though because it shouldn't have run more than 2 at time no matter what max at once says, it checks free GPU memory etc.

it gets technical now though to see if there's an issue, i might have to code a logger and things like that for you to test. Maybe NVidia causing a problem idk.

the speed should be about the same with 1 or 2 and large model, nothing major i don't think.

It would be good if you could open task manager, go to details and see how many main.exe are running at once. should never be more than 2 for large model.

commented

I lowered it down to 2. Here's what I'm seeing in Task Manager:
Screenshot 2023-09-02 121827

In case you can't see that, it says Whisperer is using 28.7% of my CPU and 121 MB of Memory. It calls that 39% but I don't see how it can be because I have 16GB in the machine and 12GB in the GPU.

My GPU is an AMD, not NVidia.

commented

you need to click on the > next to whisperer to see main.exe

i meant your old nvidia card, maybe left over stuff causing weirdness.

but to test boost max at once back up to 10 to see how many main.exe start up.

commented

image

Boosted up to 10:

image

It changes every second.

commented

ok so leave it like that and check if main.exe count goes over 2-3.

commented
commented

yes

commented
commented

no difference, only if you see it going wild with many main.exe, that's not good. it's checking available GPU memory and waiting until enough to launch another main.exe.

2 instead of 1 might be slightly faster in the long run.

commented
commented

well to see if there's a bug you need to leave it at 10, if you set it to 2 there's no chance main.exe count will go over 2.

commented
commented
commented