You generally still file, reporting zero. Registration creates a filing obligation that continues until you formally deregister.
Zero returns left unfiled generate notices and penalties even with no tax owed. If you no longer have nexus, close the registration rather than letting it sit.
We handle this for founders running US companies.
Full guide
How to Handle Multi-State Tax Filing