Oh. This has nothing to do with the fact that it's a scroll-based interaction. It looks like it just doesn't work correctly with your mouse—i.e. you ran into a bug, not something that's wrong with scrolling in principle. But yeah, that looks like an annoying bug (maybe related to mouse having very high res scroll?).

I tried with trackpad and mouse on my end, and the app is well-configured for both of my devices at least: I'm able to have fine-grained control over my location by making small adjustments to scroll position.