No. You register your existing entity as a foreign entity in that state, which is a filing rather than a new company.
Registration brings an annual report, a registered agent in that state, and possibly state income or franchise tax. One remote employee is often enough to require it.
Inkle Tax prepares and files US federal and state returns for your company.
Full guide
How to Handle Multi-State Tax Filing