You can only have one active horse at a time—that is, only the horse you last rode will fast travel with you or stay where you left it, and even then only if you own it. Other horses that you ride will begin to travel back to their original locations if you mount a different horse.