The western wall is considered holy because of its connection to the Temple Mount. Because the Temple Mount is hard to enter, the wall is the holiest place for Jews to pray.
People used to take chips off of the wall, or gather sand from the cracks as souvenirs. Now, these acts are considered desecration. The only thing from the wall that you can take, is the vegetation growing in it as it is not considered holy.