That works fine until you need to pause or click something. Surely there must be a way to use the Apple TV remote for this I thought. I was surprised that there was not (at least not in a simple, open way), so I started poking at how the Siri Remote communicates with macOS and spent a weekend mapping its inputs to cursor movement, scrolling, and media controls. The result is a small menu bar app called Remotastic.
It's simple, written in Swift, built mostly for my own comfort but I figured let's open source it as I'm sure somebody else will be looking for the same thing!