On the Apple TV Remote on iPod touch, you can use buttons instead of swipe gestures.
Go to Settings > Accessibility > Apple TV Remote, then turn on Directional Buttons.