Maybe I'm missing what you want?
Mute the volume on your nuvi.
Turn off Bluetooth on your nuvi.
Use your Smartphone with earbuds set to auto answer