When you first set up Apple TV, you may be asked if you want to use Siri (depending on your country and language). You can change your mind at any time and turn Siri on or off.
Open Settings on Apple TV.
Go to General > Siri, then turn Siri on or off.