What you describe is more like black start, providing power to the grind when it is down. This has to be controlled well, and only a few plants need to be capable of it.

Grid following means something like whatever the grid does, the inverter injects power supporting it. A grid forming generator or inverter also follows the grid somewhat, but tries to get it to an optimal condition. This entails things like voltage control by reactive power, frequency control by operating reserve, fault ride trough capability and so on. Many of those are naturally provided by large conventional power plants using synchronous generators like gas, nuclear or hydro. For inverter based systems, they have to be considered explicitly. For battery storage most are relatively easy to implement, some also in solar inverters. The tech exists, but yes, in some countries the regulations have not kept up with rapid expanse of inverter based power generation in the last years.

As always, there is a relevant xkcd for this: https://xkcd.com/2608/

The AI needs help to cut the loop, perhaps it needs a new set of knives?

I was always annoyed by this question for the same reasoning. However, as another person already said, you can sometimes feel it in some part of the body. When feeling bad, it feels like pressure in my stomach, there a a few other.such connections. Now I find it somewhat useful as part of mindfullness.

I do still get annoyed when asked this question, partly because whenever he asks the question i do not feel it anywhere, also it seems irrelevant. But the main reason is probably defiance that this seemingly stupid question of him was sensible all along. So much I had to write this response.