Check to see what type of document you are linking to. if you are clicking on a link from a menu item and the menu item is set to go to a specific article layout and that article is unpublished, then you will need to publish it. hard to know exactly what's going on without more information on the situation, but try that suggestion.