Lower/remove the number for better chance of world records? You must have forgotten something.
WCA guideline & regulation is meant for competition, and guess what's the purpose of a competition? It's to find the best competitor among competitors.
Indeed with a smaller minimum number, we can have even faster record, but does it makes the event more competitive? No. We are currently still only register up to 0.01s accuracy, with a 3 mover or a 2 mover (for 2x2), top solvers will most likely getting the same results, which defeat the whole purpose of having a competition.
Ultimately a competition is to find the best competitor among competitors. With a higher number, there is higher chance we get to find who's the bestest among the best.
So, in my opinion, it's a hard no. In fact it's quite the opposite now, if the top levels continue to be this saturated, the minimum number should be raised.