Current is only limited by reactance, which isn't much greater in the
battery than in the cap.

I think it is, it's made to store and slowly release not give up the ghost
quickly.

It doesn't "slowly release". The impedance would have to be sky high for
that to be true.