It might just be your perception. I usually get similar or better loading times from opening the original URL, and this has been shown to be quite common by independent benchmarks, AMP pages have acquired a lot of bloat.