I never really shipped them, to be honest. The more interesting angle for me is how Saiki, who actively despises everyone's auras, ends up tolerating Toritsuka's existence at all. It's a testament to how utterly harmless Toritsuka is, I think. Saiki sees him as more of a persistent, mildly annoying bug than a genuine threat. Their 'friendship' is so one-sided—Toritsuka desperately wants to be Saiki's cool psychic buddy, and Saiki just needs someone who already knows his secret so he doesn't have to explain the supernatural stuff from scratch. It's a dynamic built entirely on utility and reluctant acceptance, which feels weirdly more authentic than some deep bond. The fun is watching Saiki's minimal efforts to rein in Toritsuka's worst impulses, not out of care, but because the fallout would inconvenience him.
That moment in the manga where Saiki begrudgingly helps Toritsuka deal with a vengeful spirit, but only because the spirit's wailing was giving him a headache, sums it up perfectly. The friendship, if you can even call it that, is explored through negatives: Saiki doesn't actively avoid him as much as others, he doesn't use his powers to permanently dispose of him, and he occasionally provides a solution Toritsuka is too dumb to find. It's an unexpected dynamic because it's rooted in such profound indifference on one side, which somehow becomes a stable foundation for the other person to project a whole relationship onto.