I'm also a new cuber and supposedly a prime candidate for learning CN, and I did try, but I find that White/Yellow is easy and the other colours are 10 times harder, though still doable with great concentration and loss of speed. That is for the Beginner LBL methods. I am now learning Roux and find that CN is near impossible even at the block building stage. I think that is due to the directional requirements, e.g. looking for pieces with the right colours or colours that need to be in front or at the back (i.e. red and orange respectively when starting with Blue as first block, and that changes if another colour is attempted.)
For Roux, X2Y neutrality is often used. You say you find white/yellow easier so let's use that as an example for X2Y. If you were X2Y neutral you could solve either white or yellow on top, and any remaining colour on the front.