No idea on the drum tbh, it’s a complex shape to try and check.
If everything measured out right, forks are straight, bearings good, it leaves... drum, gears, and the little spacers between things.
Assuming everything checks out, your plan doesn’t sound unreasonable, I know my second gear functioned a bit wonky and then all the sudden it didn’t work at all and it was rounded dogs. Sounds like maybe the same thing, your 5th worked fine up until a certain wear point and then it stopped working right.