I Only Use One Shipping Method. Can I Remove the "Refresh Rates" Link on Checkout?

Unfortunately, you cannot.

This link is necessary since there are multiple scenarios in which rates will not display until the link is clicked to refresh rates.