Holding yellow on top, it looks like you could solve the orange column to the right of the orange centre, the green column to the right of the green centre, and so on; or you could solve the orange column to the left of the orange centre, the green column to the left of the green centre, and so on. However, these two solved states have different permutation parity: you cannot go from the "columns left of matching centres" solved state to the "columns right of matching centres" solved state. The reason for this is that they differ by two 4-cycles on the corners and a 4-cycle on the edges, which is an odd permutation.
In this case, after you've tried solving most of it to "columns right of matching centres", you've found that you need to swap just two pieces, which is an odd permutation. In other words, "columns right of matching centres" was the wrong guess, and "columns left of matching centres" is the only attainable solved state on your puzzle. (Unless you disassemble and reassemble it into the other one, of course.)