Ever wondered how large-scale systems slash GC pauses from seconds to milliseconds—and what lessons you can deploy in your own stack? Twitch’s journey with Go’s garbage collector is an eye-opener. Recommend as must read for all #performanceengineering guys. Key points: 1️⃣ GC Pause Reduction Multi-seconds → <1ms (100x faster) Achieved via GC tuning & evolution (Go 1.2 → Go 1.7) 2️⃣ Concurrent & Incremental GC Go 1.5 introduced mostly-concurrent GC 10x latency reduction → chat survived massive loads smoothly 3️⃣ Root Cause Analysis Perf profiling uncovered GC bottlenecks: Stack shrinking Finalizer scanning Fixes shipped in Go 1.6 & Go 1.7 4️⃣ NUMA & Memory Locality NUMA page faults = hidden latency culprit Pinning/tuning cut pauses from 70ms → 10–15ms Outcome: GC improvements for the whole Go ecosystem
How Twitch reduced GC pauses in Go from seconds to milliseconds
More Relevant Posts
-
Is MoQ a replacement for WebRTC? On WebRTC Live Episode 105: Live From the #RTCON2025 Conference, Will Law of Akamai Technologies explained to host Arin Sime that Media Over QUIC isn’t here to replace WebRTC, but to complement it and expand what’s possible with real-time data. Watch the full episode and read highlights on the WebRTC.ventures blog: https://lnkd.in/eAiZgkTK “I think if you're coming from a WebRTC world, it's sort of a very interesting adjacent technology. And I'm not here by any means to say, drop WebRTC and move to MoQ. I'm saying MoQ brings you a lot of tools and features that you will find very interesting. And if you come from a WebRTC background, you will appreciate them far faster than some people who have no idea what I'm talking about there. So yeah, it's Media over QUIC limits it to media, but it doesn't have to be media. It's payload agnostic. So it's moving arbitrary binary payloads in a Pub/Sub network very efficiently and smoothly. And video is an excellent candidate for payload, but it can be database updates. It can be GPS coordinates of race cars around a track. It can be security system updates. There's a lot of linear timeline information that I want to move between different nodes, and I think that's the market application of MoQ as it extends beyond audio and video.” #WebRTC #MOQ #RealTimeData #LowLatency #StreamingTech
Is MoQ a replacement for WebRTC?
To view or add a comment, sign in
-
Local file search (local_file_search project) is not so local anymore. Added Perplexity Search API today. Had added the Tavily search API a few weeks ago. Now, users can choose between documents, texts, PDFs, embedded files, images, and web search, all without exiting the chat window. Everything is grounded, and nothing leaves the system. The video shows searching via the Perplexity API and switching to image chat. Perplexity
To view or add a comment, sign in
-
4B OCR with Apache-2.0 license outperforming Mistral OCR 🔥 Tencent released Points-Reader, it's a new model firstly trained on Qwen2.5VL annotations and then self-trained on real data in many benchmarks, it performs better than Qwen2.5VL and MistralOCR! model → https://lnkd.in/duA5Ng3d demo → https://lnkd.in/dV-hN6bp it works on English, it can extract text, table and LaTeX, but not images, so use accordingly!
To view or add a comment, sign in
-
-
🚀 Excited to share that the PCF Gallery team has featured two of my Power Apps Component Framework (PCF) controls: 🔐 Encrypted TextBox 🔓 Decrypted TextBox These components are built using React, Fluent UI, and CryptoJS, enabling secure encryption and decryption of text directly within Power Apps. 🔧 Whether you're capturing sensitive input or displaying decrypted values securely, these controls offer flexibility, customization, and modern UI integration. Check them out on GitHub: 👉 Encrypted TextBox - https://lnkd.in/gdV_4c3t 👉 Decrypted TextBox - https://lnkd.in/gBHES97P Big thanks to the PCF Gallery team for showcasing this work! 🙌 #PowerApps #PCF #React #FluentUI #CryptoJS #LowCode #Makers #MicrosoftPowerPlatform
new #PCFs control added: Encrypted TextBox and Decrypted TextBox by Arpit Shah https://lnkd.in/d-hR85f7 https://lnkd.in/dT93n2Zr #PowerApps #PowerPlatform #PowerAppsComponentFramework #PCFGallery
To view or add a comment, sign in
-
Today Google DeepMind released a state of the art computer use model, in partnership with Browserbase. Computer use is hard to evaluate. You need reliable browser infrastructure and realistic tasks. Here, we cover how we ran these benchmarks and how you can try yourself! https://lnkd.in/gapV7aKd
To view or add a comment, sign in
-
TensorZero 2025.9.3 is out! 📌 This release adds dynamic OTLP headers for OpenTelemetry, `allowed_tools` field support for the OpenAI endpoint, and adaptive HTTP2 connection pooling for better performance. Changelog 🆕 Add support for dynamic OTLP headers when exporting OpenTelemetry traces. 🆕 Add support for `allowed_tools` field in the OpenAI-compatible inference endpoint. 🆕 Improve performance by automatically adjusting the number of HTTP2 connections to model providers based on concurrency. We're skipping 2025.9.2 due to an issue in the release process. & multiple under-the-hood and UI improvements (thanks yuria-loo!) https://lnkd.in/gRukU2Z7
To view or add a comment, sign in
-
📢Last batch ! Balanced sampling as a tool for useful PBT random tree generation (Jim Newton) -> get more representative outputs for your ASTs Running LLMs Locally with Scala: From APIs to Local Inference (Sören Dréano) -> privacy, speed and type safety to build AI-powered apps
To view or add a comment, sign in
-
Good news: exchanging media between Asterisk and your apps just got easier! The new chan_websocket module lets you move audio over WebSockets without dealing with RTP headaches. It works with popular codecs, supports secure connections, and handles timing and silence for you. You can even send files or AI responses and Asterisk will play them back cleanly. Control calls with commands like ANSWER, HANGUP, or PAUSE_MEDIA and get real-time events back on the same path. Incoming or outgoing connections are supported, making integration more flexible. More info is available on the Asterisk documentation page and code samples on GitHub. ➡️ https://hubs.ly/Q03J003z0
To view or add a comment, sign in
-
-
I’ve been exploring lightweight ways to run LLMs locally on Mac. First came across llama.cpp https://lnkd.in/gnHM2VRX, a simple and fast way for serving models. While browsing for GGUF models, I also found Unsloth https://docs.unsloth.ai, an interesting project for fine-tuning and optimization. Always happy to see people still working on local and efficient LLM solutions, not just large-scale infrastructure.
To view or add a comment, sign in
-
Ever tried to randomly sample from a stream of unknown size? Your Math.random() approach works great... until your server runs out of memory. After a short break a new article is out about reservoir sampling - the elegant algorithm perfect for shuffling, and why you can't just "shuffle the array." https://lnkd.in/eaKfnf2T
To view or add a comment, sign in
✅Performance Architect ✅ Java+Database Performance Engineer ✅ SRE ✅ Platform Engineering , Full Stack Dev
2moRead more here: https://blog.twitch.tv/en/2016/07/05/gos-march-to-low-latency-gc-a6fa96f06eb7/