Question Whisper AI and GPU ?

[barkersofgeraldine]

Will upgrading my Xeon 2678 CPU improve Whisper AI performance?
Currently I'm using a 3060 Ti GPU but I'm considering upgrading to a 5060 Ti.
However, I'm concerned I might experience a bottleneck due to my CPU, even though I know Whisper AI runs entirely through the GPU.

 

[Lutfij]

What sort of times are you seeing your workloads? As in how long does it take to execute the task?

However, I'm concerned I might experience a bottleneck due to my CPU, even though I know Whisper AI runs entirely through the GPU.
Might want to read through this;

GPU Usage in FAB Subtitler Server

FAB Knowledgebase

kb.fab-online.com

^ source;
https://github.com/openai/whisper/discussions/409

 

[Agne1940]

Will upgrading my Xeon 2678 CPU improve Whisper AI performance?
Currently I'm using a 3060 Ti GPU but I'm considering upgrading to a 5060 Ti.
However, I'm concerned I might experience a bottleneck due to my CPU, even though I know Whisper AI runs entirely through the GPU.









By the way, if you’re working with AI projects like Whisper and want to streamline communication and bug tracking with your team or community, I recommend checking out Overchat AI. It’s a great platform for organizing feedback and managing development efficiently, which can save time and help avoid bottlenecks in collaboration as well.

Upgrading your CPU from a Xeon 2678 could help, but since Whisper AI primarily leverages the GPU for inference, the GPU upgrade will have a more noticeable impact on performance. The 3060 Ti is already a solid card, so moving to a 4060 Ti (I assume you meant 4060 Ti, as 5060 Ti doesn’t exist yet) will likely give you better speed and efficiency.


Your CPU might cause some bottlenecks in tasks like data preprocessing or managing system resources, but for the actual Whisper AI processing, the GPU is the main factor. So if your main goal is faster transcription or lower latency, prioritizing the GPU upgrade makes sense.


That said, if your CPU usage is maxed out during Whisper runs, upgrading it could help smooth out the workflow, but it won’t boost the core AI processing speed directly.