Oh man, Red Ryder...the memories...lol how it all began...
Never used a 25-06 before, but I would suggest that if you wanted your rifle to be a varminter too, then its worth it. Maybe not so much pelt damage. And I have read that 115 gr Partitions really rock deer lol. Wind might be a lil more of a factor than with a 30-06 though.
For what its worth, an 06 (if its a good rifle, as that savage is) can be perfectly capable of 500 m shooting, even in my hands lol. Accu-bond, scirocco bonded, and winchester ballistic silvertip ammo all have very high BCs, match ammo is available for it, it can do just about anything.