Old battery's probably swelled up and that's why it's getting stuck. Don't be shy about removing the entire top cover and front of the frame, if needed.