There are always bottlenecks . In this case if the CPU cannot provide the GPU with enough work yes you can have a bottleneck. When mining all that will happen is that your system will be limited in the number hashes it can generate by the CPU instead of the GPUs.