We rewrote Twisted Deferred handling to be 30% faster.
We optimized the Twisted Reactor event loop to not only do less constant work, but to prefer incoming I/O.
...We spent long nights poring over profiling readouts and traces, wrote our own monitoring system, and wrote our own benchmarking tools
... We enabled cgroups on our Python process to tightly control memory usage and swap contention without requiring a different Python memory allocator scheme.
This is very interesting for the rest of the Python/Twisted community - now that they are not using this (and so is'nt part of the secret sauce), I wonder if they are willing to push this out as a patch/blog post ?
...We spent long nights poring over profiling readouts and traces, wrote our own monitoring system, and wrote our own benchmarking tools
... We enabled cgroups on our Python process to tightly control memory usage and swap contention without requiring a different Python memory allocator scheme.
This is very interesting for the rest of the Python/Twisted community - now that they are not using this (and so is'nt part of the secret sauce), I wonder if they are willing to push this out as a patch/blog post ?