Logic Pro X Can't Get Loops To Work

The manual says just drag the loop from the library into your project. I have a project which has all midi tracks and when I drag the loop into my project it goes right back to the library. It's not staying in my project. The manual says it could be either an audio loop or midi. What am I doing wrong?
Thanks for any help.