it's skin related... tell us which skin you are using or look for sth like:

			$Item->locale_flag( array(
						'before'    => '   ',
						'after'     => '',
					) );

and remove these lines in your index.php (and/or posts.main.php)

Thanks,
I am using the "custom" skin:
http://uppsalafoto.se/blogg/
Is it a good idea to just replace the american flag with a swedish? (Or a white square)

like i said,

remove

		$Item->locale_flag( array(
						'before'    => '   ',
						'after'     => '',
					) );

to get rid of the flag display, it is around line 194-197 in 'index.php' for the 'custom' skin