How can I train my 3 year old dog?

I adopted a toy poodle from a puppy mill last January. He is very smart and has picked up a lot of commands with no trouble. The one thing I am having an issue with is his potty habits. He is paper trained, but when he poops he often does not get it on paper. I have watched him from afar and he keeps doing circles and by the time he does begin to go he is off the paper. I live in apt and I have been taking him out every chance I get to go to the bathroom, but nothing is consistent. I was using the crate to train him, but still have issues with him landing his turds on the floor. HELP