Kimi does mean 'you'. It's mostly used by men, and if you listen to Japanese music you will find that many male singers use it. Therefore, often it is used in reference to females. It's very casual, so only use it with someone you have known for a long time