The library exists in the Hokage Monument. The way to get in is if your a leaf ninja or accompanied by a leaf jounin, if you are an outsider. To get in you must travel from the Hokage Monument.