What is the process by which rock is broken down

Weathering breaks it down, erosion takes it away

Hello there! 

If you're talking about rocks that break down into smaller fragments by the atmosphere and other factors, it would be called weathering. Through the contact with the atmosphere of the Earth and other factors in the environment like biota and water -- rocks, soil, and minerals are broken down. 

Hope I helped. :)