Robert de Bock has a number of OpenSSH tricks up on Undeadly.  The first one, ‘Using SSH Keys‘, should be required reading.