Do I need special nuts for fine-pitch threaded rods?

Yes. A fine-pitch threaded rod requires nuts with the matching fine UNF thread size.