How do you keep large-scale data operations running without bottlenecks? Jonathan Rainer, former Platform Engineer at Monzo Bank, shares how his team uses Airflow to schedule and manage complex compute workloads efficiently. We discuss scaling challenges, automation and the role of orchestration in modern data workflows. Follow the link in the comments for the episode. #AI #Automation #Airflow #MachineLearning
How to manage large-scale data operations with Airflow
More Relevant Posts
-
Even though it might sometimes feel like it, AI isn't a magic tool. At Sibos 2025, Charlie Platt, Managing Director Banking, sat down with Finextra TV to discuss the importance of a solid data infrastructure. In order for AI to work at it's full potential, it first needs quality input before looking at use-cases. Watch the full interview here 👉 https://lnkd.in/dUY6N5Qa
"AI isn't a Magic Tool": Why Data Infrastructure Matters More Than Use Cases
https://www.youtube.com/
To view or add a comment, sign in
-
Brilliant insight from Charlie at Sibos 2025. He perfectly articulates the strategic pivot required in our industry: AI isn't the magic; it's the architecture We often rush to chase the use-case headline, but without a high-quality, reliable data infrastructure, any AI initiative is just building a sophisticated house on sand. Quality input is the non-negotiable prerequisite for meaningful output #Banking #Technology #AI #DataStrategy #Sibos2025 #DigitalTransformation #SAPFioneer
Even though it might sometimes feel like it, AI isn't a magic tool. At Sibos 2025, Charlie Platt, Managing Director Banking, sat down with Finextra TV to discuss the importance of a solid data infrastructure. In order for AI to work at it's full potential, it first needs quality input before looking at use-cases. Watch the full interview here 👉 https://lnkd.in/dUY6N5Qa
"AI isn't a Magic Tool": Why Data Infrastructure Matters More Than Use Cases
https://www.youtube.com/
To view or add a comment, sign in
-
What it means to be "AI-native" from a C-suite exec at a top-10 U.S. bank: "Our CEO insists that we apply GenAI to every core process to generate a 10% efficiency gain before considering traditional data/tech or even basic process simplification."
To view or add a comment, sign in
-
Did you know that up to 75% of banks' GenAI pilots never scale beyond the proof of concept stage? Legacy systems, limited access to quality data and misaligned strategies are holding progress back. Sandeep Reddy, Omar Bashir, Sannesh Prabhu and Wayne Te Paa came together and created an insightful guide to help banks transform their pilots into measurable results. Discover: ✅ The role of GenAI in legacy modernization ✅ Steps to craft a successful GenAI strategy with clear metrics ✅ Key elements of a strong AI-ready foundation The banks that successfully scale GenAI today will shape the industry's future. Don't miss out on this opportunity to lead the change! 📘 Get your copy: https://ter.li/3ch2wo
To view or add a comment, sign in
-
This might be written for Banking, but it is just as relevant to the public sector and healthcare. These sectors face many of the same challenges: older systems that slow things down, data spread across different places and regulatory complexity that makes change harder. What I like about this guide is that it lays out a clear, practical path for taking GenAI from early experimentation to real impact. The focus on modern platforms, good governance and small, measurable steps feels right for organisations that need to move carefully while still making real progress. If it gets you thinking about what this could look like in your organisation, feel free to reach out. The team and I would love to help you explore what’s possible. Phil Cadell, Rachel Muston, Ash Marshall. PHF MBA MAICD, JP(Qual) #PublicSector #Healthcare #Innovation #GenAI #DigitalTransformation #AIAdoption #FutureOfServices
Did you know that up to 75% of banks' GenAI pilots never scale beyond the proof of concept stage? Legacy systems, limited access to quality data and misaligned strategies are holding progress back. Sandeep Reddy, Omar Bashir, Sannesh Prabhu and Wayne Te Paa came together and created an insightful guide to help banks transform their pilots into measurable results. Discover: ✅ The role of GenAI in legacy modernization ✅ Steps to craft a successful GenAI strategy with clear metrics ✅ Key elements of a strong AI-ready foundation The banks that successfully scale GenAI today will shape the industry's future. Don't miss out on this opportunity to lead the change! 📘 Get your copy: https://ter.li/3ch2wo
To view or add a comment, sign in
-
Vivek Radhakrishnan & Fabien Thiaucourt from Mastercard just revealed how they're building AI-ready data products. The insight? Engineering + enablement must work together. Vivek leads engineering. Fabien leads enablement. Together, they're embedding "context by design" into every data product. What that looks like: - Automating metadata across the data lifecycle - Curating a data product marketplace - Building foundations for conversational search - Uniting technical precision with governance intent "AI success starts long before the model. It starts in the data." https://lnkd.in/ex2eY_Ck
Mastercard’s Blueprint for Modern Data Governance
To view or add a comment, sign in
-
How will GenAI impact fintechs? Credit decisions must be transparent and explainable - for our users and for our bank partners' regulators. So, does Clair Atlas use GenAI? The answer is yes. We don't use it for the core scoring decision. We do use it for what it's great at: data enrichment. In this clip from our fireside chat, our lead data scientist Veronika Shmagina explains our philosophy: use the right tool for the right job and never sacrifice transparency.
To view or add a comment, sign in
-
Are community banks getting enough value out of their data? ↪️ Not even close. Our Chief AI Engineer, Bauyrzhan A., took to the camera to share some insight into how community banks can better monetize their data. ⬇️
To view or add a comment, sign in
-
Missed us at Money20/20💡 Dive into this must-listen panel discussion on the future of AI-driven infrastructure in cross-border payments! SoundHound AI's CIO, Shawnna DelHierro, joined industry leaders Sudipto Das (Convera) and Nilesh Dusane (AWS AI) for a live conversation hosted by David Savage (Tech Talks). They explored critical questions facing FinTech today: 💳Generative AI's role in payment infrastructure. ⚖️Balancing innovation with safety, governance, and risk management. 🤝Defining the evolving, irreplaceable role of humans in financial services Listen now: https://hubs.li/Q03TfSf50
To view or add a comment, sign in
-
iTunes: https://podcasts.apple.com/us/podcast/overcoming-airflow-scaling-challenges-at-apollo-graphql/id1337349579?i=1000689830535 Spotify: https://open.spotify.com/episode/6R1LbkY8LEs4kAx48cQzb0 YouTube: https://youtu.be/4QM593t4S-c