DoubleVerify Engineering

The biggest performance boost may not come from optimizing your code - but from understanding your traffic. At the hayaData Conference, David Nahmias explored a powerful yet often-overlooked truth: at high scale, performance starts with your data - not your tech stack. In his talk, “The Hidden Key to Performance at High-Scale: Your Traffic,” David shared how analyzing real traffic patterns across a system handling 100 billion+ daily requests made it simpler, more robust, and significantly faster. He broke it down into four key rules: 1. Does it even have traffic? Don’t solve a problem that doesn’t exist. 2. The main case should be the main case. Optimize the high-volume path first. 3. Be friends with your data. Explore correlations before coding. 4. Understand why patterns exist. Real-world causes bring stability and confidence. A striking example: prioritizing just two common rules first dropped latency to 25% of the original time, no new tech required. Sometimes, the smartest optimization is simply getting closer to your data. 🎥 Link to the talk recording in the first comment. What’s one insight you’ve uncovered by truly understanding your traffic?

Observability is essential to ensuring the reliability of distributed systems -especially when those systems run in environments you don’t control. In his blog post, Surya Nittala, Sr. DevOps Engineer at DoubleVerify, shares a step-by-step guide to designing observability pipelines using Vector by Datadog. The post explains how the team collects and routes Prometheus metrics from Kubernetes clusters to a centralized Prometheus instance-efficiently and securely. Read more here: https://lnkd.in/dwjbH3vQ Surya N.

We are proud to sponsor the GenML 2025 conference, taking place at the ZOA House in Tel Aviv on November 25! Our very own Rafael Sultanov, Data Scientist at DoubleVerify, will be speaking on: “Few Labels, No Fine-Tuning: Rapid Creation of LLM Classifiers.” Rafael will present a practical framework for rapidly building high-quality, task-specific classifiers by optimizing LLM prompts instead of retraining models. This approach reduces development time and cost while achieving superior performance using only a few labeled examples and no specialized hardware. GenML brings together Israel’s machine learning and data science community to exchange ideas, explore new research, and showcase innovation in the field. We’re excited to be a part of it! Check the first comment for a link with more info about the conference.

See you at the meetup tomorrow! 🎉

Excited to share that our next DoubleVerify Engineering Meetup in NYC is happening next week! “The Lego Approach: Data Management at Scale” will be co-hosted with Brooklyn Data and dbt, and will take place at our DV New York office on October 28 (6:00 - 9:00 PM). Learn to Transform Your dbt Projects: From 3 Weeks to 2 Days - Discover how our modular abstraction approach slashed data source onboarding from 3 weeks to just 2 days while ensuring consistent metrics across all pipelines. Join us to learn: - Performance optimization strategies for abstraction at scale - Proven tactics to get teams adopting reusable components - Practical frameworks for identifying what to abstract Perfect for anyone dealing with metric inconsistencies or drowning in duplicated transformation logic. You can walk away with concrete, actionable patterns to make your dbt projects more maintainable and scalable. Learn, network, and eat with us! DoubleVerify HQ 28 Crosby St, 6th floor ➡️ RSVP Required - link in the comments Aravind Ramesh Mahima Arya dbt Labs

Coming soon - Haskell Ghent meetup! Belgium engineers: Join us at our Ghent office on Monday, Oct. 20, for food, drinks and an informal introduction to this modern, purely functional programming language. We'll solve two simple problems using Haskell fundamentals including pure functions, monads for side effects, and algebraic data types. This event is organized in partnership with the System Programming Ghent group. Read more and RSVP here: https://lnkd.in/d6xGixrk

What a week at Devoxx Belgium 2025! We were proud to sponsor one of Europe’s leading developer conferences - connecting with so many passionate developers, sharing ideas, and learning from inspiring sessions. Missed Ivan Schwarz's talk “When auto-scaling isn’t fast enough: Handling high volume live event traffic”? Watch the recording here: https://lnkd.in/dgQSrhVe Huge thanks to everyone who stopped by our booth and joined the conversation - it was great meeting you all! 

Honored to have our own Ivan Schwarz speaking at Devoxx 2025!

DV is proud to sponsor Devoxx Belgium 2025, one of Europe’s leading developer conferences! We’re excited to join thousands of engineers in Antwerp to share ideas, learn, and connect. 🎤 You’ll also catch one of our own on stage: Ivan Schwarz will be speaking about high-volume live event traffic and unpredictable spikes - read more here: https://lnkd.in/d5kCwbGf Come find us at the booth and say hi! Let’s talk tech, tools, and everything in between. #Devoxx #DevoxxBelgium #Engineering #TechConference

Processing complex, nested data can be time-consuming and error-prone, especially at scale. In his latest blog post, Zoltán Buka, Sr. Product Analyst at DoubleVerify, shares how using higher-order functions in Spark SQL helped streamline data cleaning and wrangling tasks across large classification datasets. The post includes a practical example tested in Databricks and applicable to other Spark-based platforms. Read more here: https://lnkd.in/dz59d8mA