That's what a linkblog does. You set up each of your blogs to use (lets say) blog #4 as your linkblog, then you post links in blog #4, then they show up in your sidebar.

New installation? The default installation uses #4 as a linkblog with sample linkblog entries in it. Read through all the sample posts, tinker with things a bit, and you'll see what I mean.