What is the best product to sharpen kitchen knives?

I bought a handheld item that has stone and I'm supposed to bring the knife back and forth on to the little stone piece but it just doesn't and if it helps a little it wears off too fast.