I personally don't really know much group theory beyond whatever I learnt in my first class of undergrad algebra either… although I kinda struggled with that and that led me to wiki-walking the
Groupprops wiki and
ProofWiki a bit, and maybe I'm lumping whatever I learnt during the wikiwalks into the class itself.
Off the top of my head, these are the useful things for analysing twisty puzzles (and also some puzzles of the non-twisty kind):
- Fundamentals. You should be familiar with things like functions, subsets, equivalence relations, the notion of well-definedness.
- Combinatorics. Important, but thankfully you don't need anything advanced. Just think of those probability questions where you have to add or multiply a bunch of stuff together to get the answer. The most advanced thing that's still useful is the inclusion-exclusion principle, and even then, you mostly don't need to touch inclusion-exclusion if you're looking at the group theory side of things.
- Linear algebra, especially over number systems other than the real/complex numbers. Real linear algebra and complex linear algebra aren't that useful in a very discrete setting, but it's fairly common to have to deal with linear algebra mod 2 or mod 3 when it comes to twisty puzzles. Again, nothing advanced needed—knowing how to solve equations and multiply matrices is enough.
- Basic number theory. What prime numbers are, unique factorisation, that kind of stuff. Nothing more than what would be covered in an undergrad abstract algebra class or its prerequisites.
- Group theory itself. Definitions of group, subgroup, coset, normal subgroup, centre, homomorphism, isomorphism, quotient group, direct product, semidirect product, abelian group, cyclic group, symmetric/alternating groups, special/general linear groups (and projective, affine variants thereof), group action, types of group action (faithful, free, transitive, etc.), orbit, stabiliser, free group, word metric. How group actions induce subgroups of symmetric groups. Sylow theorems are good to know (Sylow subgroups always exist; all Sylow p-subgroups are conjugate; nobody can remember the others) but mostly not very important.
- Other objects studied in abstract algebra. Not so much to analyse with group theory, but more to know the terminology and also serve as examples of things that are
not groups. For example, the sets of legal move sequences on bandaged puzzles (including jumbling ones) behave like groupoids.
Might extend this list later on if I think of anything else to add.