It a problem everyone has. I've noticed that a lot of other guilds, the big ones anyway are often focused on something with a decent following. Something else I've noticed, is that...
Well, let's use the multitude of Naruto RP guilds out there.
They don't actually have that many members, not really. Because 75% of the members of each guild are in every other guild. There are lots of other fans out there but it's just the fact that most don't get that into it.
The same can be said for writing. While it's something a lot of people do, most are solitary, which is how they got into writing in the first place. Not to mention that there are other sites dedicated solely to writers. I'm a member of a few. I'm more likely to take questions and concerns there, because they have staff that are there just to support writers.
Now, it's not that you're bad as a captain. It's that you haven't found something that people really want to be a part of. I have no problem hanging around chatting with people, or even getting into conversations like this. I'm mostly loyal if I want to be involved with something. For instance this.
In the end, I'm horrible at finding people to join. Because for the most part I just go around asking. They might join for a few days then vanish. They really need a shrug emoticon.