A great page about it

Typically, optimization involves choosing the best overall algorithms and data structures. Frequently, algorithmic improvements can cause performance improvements of several orders of magnitude instead of micro-optimizations, which rarely improve performance by more than a few percent. If one waits to optimize until the end of the development cycle, then changing the algorithm could require a significant rewrite.