Djokovic said he knew it was a mountain too high to climb after dropping the first set and therefore had to retire hurt.