I have heard many people say "up to Jerusalem", i think as a sign of respect. It also happens to be that it's on a mountain, so you do have to go up.
But is there a problem with saying "down" to/in Jerusalem? Like, from northern Israel, Jerusalem is to the south, commonly known as "down". Perhaps an issue of disrespect?