On the Apple TV Remote on iPad, you can use buttons instead of swipe gestures.
Go to Settings > Accessibility > Apple TV Remote, then turn on Directional Buttons.