Should we fear for Switzerland's competitiveness?

After the vote on the free movement of people, will Switzerland lose its gold medal for economic competitiveness? Should we fear for our trade with the European Union (EU)?