There are lots of items to increase SP recovery rate actually.
Many staffs/rods/maces feature SP Recovery (Tilly Rod, Catacombs Club e.g.) as well as equipment (mostly Cloth type like Virtov Boots, Roxona Robe; other equips like Sage Wall, Pore, Agni Necklace e.g.).
There’s also the possibility to get up to +42 SP recovery enchant per head accessory and Blue Gems slotted into gloves help,too (a lvl 5 blue gem adds +22 SP recovery e.g.). With all these factors united you can easily hit an SP recovery of several hundreds per tick, which should greatly reduce your requirement to “pot”.
You can also actively lessen the load by sitting down every 10 seconds to cut your recovery time in half; since the sitting SP recovery tick is 10 seconds while the standing tick is 20 seconds, you can double the amount of SP recovered in the same time this way, thus making your SP recovery rate twice as effective.