No idea on the drum tbh, it’s a complex shape to try and check.
If everything measured out right, forks are straight, bearings good, it leaves... drum, gears, and the little spacers between things.
Assuming everything checks out, your plan doesn’t sound unreasonable, I know my second gear functioned a bit wonky and then all the sudden it didn’t work at all and it was rounded dogs. Sounds like maybe the same thing, your 5th worked fine up until a certain wear point and then it stopped working right.
There's also a ****-tonne of play in the drum grooves for the fork lugs to slide through ... in fact I'd go up a level in adjectives and call it slop rather than just play