Can I use fertilizer in my Oyas?

We say don’t. 

Theoretically, if the fertilizer you are using is completely water soluble (dissolves entirely in the water) it could work. But the tight pores of the terracotta will act as a filter for any larger particles, and could clog.

And really, how often do you need to fertilize? Make that your surface watering exception.