[Jimjam]

Use 1st person, using right click look up, walk at the ladder to climb (look down and walk to climb down).

If in 1st and 3rd person you can also hold pgup or pgdn to make the character look up and down.