[khandman]

If the item is Inventory clickable, best to drag the empty Inventory slot over to your hotbar instead of the slot filled with the clickable item.

Edit : Same for equipped items, drag the empty equip slot to the hotbar.