You got a smart speaker but you're worried about privacy. First off, why'd you buy one? Secondly, check out Project Alias

Gizmo deafens eavesdroppers, and you can build one yourself

Project Alias is a homebrew gizmo that aims to deafen Alexa and Google Home until a user is good and ready for the creepy little cylinders to pay attention."