When you go to the lower left hand and tap on the Menu button you can very easily turn off the speaker.

It is just under the Menu Button.

I have done this mistake many times.