It's all done with widgets. Go to Blog settings -> pick a blog -> widgets and remove the appropriate widget from whatever container it is in. Same goes for adding new stuff: from the widgets tab, click "add widgets" for the appropriate container then add whatever widget suits your fancy.