If you have a fixed-rate mortgage and mortgage rates are falling, it only makes sense to consider trying to refinance at a lower rate. But as with most things in finance, it isn’t always a simple answer. Refinancing can certainly make sense, but it also costs money to refinance a mortgage. Depending on your specific situation, a refinance may actually end up costing you more money instead of saving money.