I don't believe that's true. Looking at historic performance of BRK-A, it's out-performed the S&P 500 betwen pretty much any starting point and right now. The only exceptions I can see are midway through the '08-'09 financial crisis, where at times the S&P had sunken faster than BRK-A, leading to having a slightly larger recovery since.