Did all egyptian pyramids have the pharaoh's tomb in them?

Yes most egyptian pyramids  have the pharaohs tomb in them 

The Egyptian pyramids are ancient pyramid-shaped masonry structures located in Egypt. As of November 2008, sources cite either 118 or 138 as the number of identified Egyptian pyramids. Most were built as tombs for the country's pharaohs and their consorts during the Old and Middle Kingdom periods.

So to answer your question I would say yes