Both you and Nate hit on the issue. Adverse yaw caused by P-factor varies depending on angle of attack, and the way the airplane is set up affects where the rudder needs to be to eliminate/compensate for that adverse yaw. If you've got rudder trim, you can trim the airplane for hands-and-feet-off straight and level flight in any configuration (assuming the airplane isn't mis-rigged). Without it, then you, Mr. Original Poster Pilot, get to be the rudder trim or human yaw damper.
Typically, in an airplane without rudder trim, the way it's rigged will result in being able to fly "feet-on-the-floor" in cruise, and you'll need rudder outside of that sweet spot.
If you can take the airplane on a calm day, and get it in the slow flight configuration, and trimmed for that airspeed so the stall warning is going off but your altitude is constant (adjust this with the throttle), if you take your hands and feet off the airplane will first yaw to the left and then that will normally couple to a roll as the right wing advances and generates more lift. Your goal is to use the rudder, and ONLY the rudder, to keep the wings level and the ball centered and the nose not moving. When you can do this and track a straight line, then try altering the rudder pressure gently... add some right rudder, and watch the nose skid around and then the airplane roll to the right. Release some of that pressure and the nose will come back left and the airplane will go back to level.
What I'm hoping you'll learn by this is the interrelation between yaw and roll. You can do this at faster speeds and then slow it down if that's more comfortable. If you keep your eyes focused outside and concentrate on what your body is telling you, you will develop a "feel" for coordinated flight. It doesn't come quickly, you gain it gradually as you fly, but slow flight really is the regime where it's most obvious. And it's also the regime where it's most important to be coordinated.
Once you have straight-and-level slow flight working well, you can try adding some turns. Remember that the PTS for slow flight is such that if you increase the angle of attack at all you'll stall. That means that if you're doing slow flight straight and level properly, a turn without a descent is going to result in a stall. So you need to add a little power before turning so that you won't lose altitude. Experiment - in the C172s adding 100 RPM allowed me to do reasonable turns at 10 degrees of roll or so, and 10 degrees of roll will get you around pretty quick in slow flight. Again, when you're turning, keep the focus outside and on how it feels to you. The earth should be going left or right underneath the nose - you ARE turning, but your nose should not be sliding up or down on the diagonal of your bank angle. You'll find that from straight and level you'll need to add right rudder pressure for a right turn, and just relax some of the "trim" pressure you'd put in for the left turns.
Above all, don't get discouraged, this is something that comes with repetition and correction, rather than learned in a couple of lessons. If you get a chance to do this in a glider or a Diamond (which has a similar wing), you'll pick it up faster as they really are sensitive in yaw.
Best wishes,