The Library is actually the largest building in the town, aside from the theater. It was built early on by both of the clans together, they built the building, and then paid for all of the books.