Depends entirely on what situation. Most times in PvP you'll definitely prefer to have the stunners in over rukia (unless you've got a lot of fury stones)
But for daily activities like Ryoka you'll want to keep Rukia in
Both Yoruichi and Harribel are great for PvP but a fast Yoruichi nullifies Harribel so I think you made the right decision.