TL;DR
Yes. Swiss nationals enjoy freedom of movement, like EU and EEA citizens: they can set up and run a company in France without a residence permit, whether they live in Switzerland or in France. The steps and fees are the same as for a French citizen: €223.56 incl. VAT in legal fees for a SASU in mainland France. 
Service-public
What to plan for from Switzerland
- A registered office address in France (an approved domiciliation provider if needed).
- A euro bank account in the company's name, with a bank that accepts non-residents.
- If you work in both Switzerland and France, the applicable social security system is determined by the same rules as in the EU; have it checked before paying yourself. europa.eu
With LegalRapide
LegalRapide accepts founders who are EU, EEA and Swiss nationals, whether they live in France or abroad.
Written by Razvan Toma, founder of LegalRapide. How we check our figures · LinkedIn