Mortgage rates moved higher last week, causing buyers to pull back, but refinancing did see small gains.