This is a lovely idea, it truly is. However, if you don't somehow bootstrap AGI, won't "the money" just use it to make more money, in the normal dark ways?

I always figured that we will begin to see signs of AGI when a quant firm starts making really outsized returns.

"Hey AGI, how do we avoid being exposed as having implemented AGI?" - Now there is the next trillion dollar and very boring question.