Many places that host their own models have the ability of caching.

Any possible plans to add caching in the future? I like the models offered, but the pricing is hard to justify compared to original API alternatives. I would like to use vultr for everything, been my main vps provider for years now, and the vector store feature is quite handy, but long term price is not justified for use.