Yes, if you registered to do business there (this is called foreign qualification). Each state needs its own Certificate of Withdrawal, separate from the dissolution in your formation state. Closing your home state entity does not close those registrations, so any state you skip keeps billing you for annual reports, franchise tax and penalties. Withdrawal fees are usually $15 to $100 per state.
Inkle handles the state and IRS filings that close a US company properly.