I actually took the Garmin and HR strap back to REI yesterday and they did replace the strap battery. I ran today and didn't get any funky numbers.
*fingers crossed*