This used to be a problem with legacy extensions because their APIs pre-dated the multi-process effort and forced Firefox into single-process mode.

In over a year of using Firefox every day I haven't noticed any slowdowns after Firefox made the move to drop compatibility for those extensions.