Mr Eddy on "[Plugin: WordPress SEO by Yoast] Double site title"

It might be easier to help if you could tell what theme your using and pate your original header.
By the way, have you tried using this :
<title><?php wp_title(''); ?></title>
with "Force Rewrites" unselected ?