You are correct, in a way. Many people like the sound of the rolling or surging idle though if the engine is tuned properly, it will have a normal idle. When diesel engines equipped with blowers idle like this, it's called the "Detroit Roll" because the roots style superchargers are found most often on Detroit diesels. Here is what is happening when a supercharged engine idles this way.
The supercharger roll is caused by the superchargers vacuum signal to the power valve not being the actual engine vacuum, but the vacuum created by the supercharger. The power valve reads the higher vacuum created by the supercharger, this vacuum closes the power valve, causing the fuel mixture to go lean, the engine then slows down due to the lean air/fuel mixture so the vacuum signal from the supercharger causes the power valve to open as the superchargers vacuum drops, so again the engine again speeds up due to the richer air/fuel mixture, rolling from rich to lean causing the engine to speed up then slow down.
I hope this answers your question.
Barry