Pinned
After several months of work, we finally enabled Pitchfork reforking on 100% of Shopify's monolith.
~30% reduction in memory usage, ~9% better latency and more!
Jean Boussier
1,368 posts
Jean Boussier
@_byroot
Rails core, Ruby committer, Senior Principal Engineer at Intercom.
Bsky: byroot.bsky.social
Mastodon: @[email protected]
- Just finished upgrading Shopify's monolith to Ruby 3.2.0 today. Average latency: -6.6% Median latency: -5.1% p99 latency: -6.7% And that's without YJIT.
- As of this morning Shopify's monolith is running Ruby 3.3.0-dev in production. In the process we fixed over 20 bugs that weren't discovered before. I like to say that this app is the true last boss of Ruby testing.
- 3 hours later, Shopify's monolith is running Ruby 3.3.0 in production! In case anyone needed any more proof of how solid this release is.Ruby 3.3 adds a new parser named Prism, uses Lrama as a parser generator, adds a new pure-Ruby JIT compiler named RJIT, and many performance improvements especially YJIT. ruby-lang.org/en/news/2023/1… Merry Christmas, Happy Holidays, and enjoy programming with Ruby 3.3!
- I finally released the first (pre)version of pitchfork github.com/Shopify/pitchf… A new Ruby HTTP Server optimized for latency and memory usage 🧵
- Bio update: s/Senior Staff Engineer on Shopify's Ruby and Rails infrastructure team/ funemployed/ After almost 12 years, today was my last day at the company. 🫡
- I often joke how Shopify's monolith is the true last boss of Ruby. I've just spent 3 days tracking down a weird test failure that turned out to be a parser bug. Millions of lines of code were running fine, only one list was impacted. So easy to miss.
- I tried to explain why I don't believe the recent accusations toward my former teammates, as well as how the Ruby and Rails Infra team at Shopify operates and why it can be trusted.
- Happy to share that today I'm starting as senior principal at Intercom!
- This morning I upgraded Shopify's monolith from Ruby 3.3.0 to 3.4-dev. We measured a ~4% reduction in latency (with YJIT).
- I merged a third String#<< optimization. Overall it's now 65% faster for UTF-8. Unfortunately my profiler is no longer showing any more low hanging fruits, so that may be the last one 😞
- This morning I though I was done optimizing the ruby/json parser, so I was doing some final cleanups before the 2.8.0 release. But nope, I found two more ~10% wins back to back... This will never end...
- It is done, I finally concluded the ruby/json optimization series. I hope you enjoyed it:
- I've just released json 2.7.3 with some bug fixes and lots of performance improvements: github.com/ruby/json/rele… This is my first release after being made maintainer two weeks ago.
