John Holden, profile picture
Uploaded byJohn Holden
194 views

Cloud Task Execution at Scale with example from quant finance

The document presents a presentation on high performance computing and numerical software, focusing on task execution at scale using examples from quantitative finance. It emphasizes the management of resources like CPU/GPU, dependencies, and synchronization during cloud execution. The presented tool, Origami, supports various execution environments and boasts significant time savings in execution compared to traditional methods.

Embed presentation

Download to read offline
Experts in numerical software and High Performance Computing Cloud Task Execution at Scale with an example from Quant Finance Microsoft SC18 Theater presentation November 2018 John HOLDEN Mick PONT
2High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
3High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
4High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com ► Manage Distribution (CPU/GPU) ► Manage dependencies ► Manage synchronization ► Manage control ► Manage ad-hoc Grid (during Development) ► Manage Cloud(s) (during Testing / Production)
5High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Client Client Client Server Client-Server Client Client Client Client-Worker worker worker worker synchronisation worker worker worker Master Master-Worker
6High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
7High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
8High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com • Origami supports DAGs including: data transfers, metrics, recovery from task failure. • Can run on dev machines, in-house grid, production cloud, CPU, CPU / GPU – mixture.
9High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
10High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Description Elapsed Time Single core ~ 14 hours Origami / Grid / Azure Minutes
11High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
12High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk
13High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk

More Related Content

PPTX
CamundaCon 2018: Ramping up: Camunda BPM and Optimize (Visana)
bycamunda services GmbH
 
PPT
2009 Webinar Closets
bymichaelgrohs
 
PPTX
What is VICO ?
byShahid Masood, BTech,PEM
 
PDF
Dream bot tractonomy midih presentation oc2
byMIDIH_EU
 
PDF
PGplant midih-presentation oc2
byMIDIH_EU
 
PDF
Mamoc dmc smart systems-midih_oc2_demoday
byMIDIH_EU
 
PDF
Cloud cv
byEugene Khvedchenya
 
PDF
Offshore lytics rolloos_midih_presentation_oc2
byMIDIH_EU
 
CamundaCon 2018: Ramping up: Camunda BPM and Optimize (Visana)
bycamunda services GmbH
 
2009 Webinar Closets
bymichaelgrohs
 
What is VICO ?
byShahid Masood, BTech,PEM
 
Dream bot tractonomy midih presentation oc2
byMIDIH_EU
 
PGplant midih-presentation oc2
byMIDIH_EU
 
Mamoc dmc smart systems-midih_oc2_demoday
byMIDIH_EU
 
Cloud cv
byEugene Khvedchenya
 
Offshore lytics rolloos_midih_presentation_oc2
byMIDIH_EU
 

What's hot

PDF
Appronto Appstore Mendix Meetup 8 dec 2014
byPim van der Noll
 
PDF
AllbeSmart - E robotic midih-presentation-oc2_demo_day
byMIDIH_EU
 
PPTX
IBM Planning Analytics - esittely ja demo
byAffecto
 
PPTX
BIM Al Fouzan
byMamoun Elfatih
 
PDF
Streamlining Feature Engineering Pipelines with Open Source
bySoledad Galli
 
PDF
COMIT Community Day - Summer 2017 Plangrid slides
byComit Projects Ltd
 
PDF
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
byFlink Forward
 
PPTX
Key2Print - Web to Print Software with an online Designer.
byDanny Moloney (DBA IP), (PhD IP)
 
PPTX
Grafixoft solutions
byGrafixoft
 
PPTX
pCon - Empower your sales force
byMiguel Vale Oliveira
 
PPTX
2018/11/1 Architecture of AI-CON
byKatsuhiro Honda
 
DOCX
Programas softwares
byAdriano Rodrigues
 
PDF
Data science @ scale
byHimanshu Yadav
 
PPTX
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
byactint
 
PDF
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
byE-Commerce Berlin EXPO
 
PDF
Webinar of IN Data Manager (EN) 18th June 2020
byInnova Advanced Consulting
 
PPTX
Intro to the Data Grid
byOutSystems
 
Appronto Appstore Mendix Meetup 8 dec 2014
byPim van der Noll
 
AllbeSmart - E robotic midih-presentation-oc2_demo_day
byMIDIH_EU
 
IBM Planning Analytics - esittely ja demo
byAffecto
 
BIM Al Fouzan
byMamoun Elfatih
 
Streamlining Feature Engineering Pipelines with Open Source
bySoledad Galli
 
COMIT Community Day - Summer 2017 Plangrid slides
byComit Projects Ltd
 
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
byFlink Forward
 
Key2Print - Web to Print Software with an online Designer.
byDanny Moloney (DBA IP), (PhD IP)
 
Grafixoft solutions
byGrafixoft
 
pCon - Empower your sales force
byMiguel Vale Oliveira
 
2018/11/1 Architecture of AI-CON
byKatsuhiro Honda
 
Programas softwares
byAdriano Rodrigues
 
Data science @ scale
byHimanshu Yadav
 
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
byactint
 
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
byE-Commerce Berlin EXPO
 
Webinar of IN Data Manager (EN) 18th June 2020
byInnova Advanced Consulting
 
Intro to the Data Grid
byOutSystems
 

Similar to Cloud Task Execution at Scale with example from quant finance

PPTX
Lessons from 40+ HPC Projects - NAG
byinside-BigData.com
 
PDF
High Performance Computing (HPC) and Engineering Simulations in the Cloud
byThe UberCloud
 
PDF
High Performance Computing (HPC) and Engineering Simulations in the Cloud
byWolfgang Gentzsch
 
PDF
Nephele efficient parallel data processing in the cloud
byArshams
 
PDF
Exploiting dynamic resource allocation for
byingenioustech
 
PDF
Systems Integrator for AI, Nor-Tech, Explains Benefits of On-Prem HPC over Cloud
byassociate14
 
PPTX
Microsoft Azure Batch
byKhalid Salama
 
PDF
Univa Presentation at DAC 2020
byUniva, an Altair Company
 
PDF
High Performance Computing: an Introduction for the Society of Actuaries
byAdam DeConinck
 
PDF
Migrating to Public Cloud
byAdrian Cockcroft
 
PDF
HPC on Azure for Reserach
byJürgen Ambrosi
 
PPTX
High Performance Computing Pitch Deck
byNicholas Vossburg
 
PPTX
Fosec2011 keynote address
bythreesixty
 
PDF
High Performance Cloud Computing
byDeepak Singh
 
PPTX
Technology insights: Decision Science Platform
byDecision Science Community
 
PPTX
Activeeon technology for Big Compute and cloud migration
byActiveeon
 
PDF
Enterprise Architecture for NexGen Solutions
byvijaym619610
 
PDF
Migliorare la Developer Experience in un mondo Cloud Native
byCommit University
 
PDF
Cloud / IFPEN Proactive Case Study - Denis Caromel, Activeon
byParis Open Source Summit
 
PDF
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
byAngela Williams
 
Lessons from 40+ HPC Projects - NAG
byinside-BigData.com
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
byThe UberCloud
 
High Performance Computing (HPC) and Engineering Simulations in the Cloud
byWolfgang Gentzsch
 
Nephele efficient parallel data processing in the cloud
byArshams
 
Exploiting dynamic resource allocation for
byingenioustech
 
Systems Integrator for AI, Nor-Tech, Explains Benefits of On-Prem HPC over Cloud
byassociate14
 
Microsoft Azure Batch
byKhalid Salama
 
Univa Presentation at DAC 2020
byUniva, an Altair Company
 
High Performance Computing: an Introduction for the Society of Actuaries
byAdam DeConinck
 
Migrating to Public Cloud
byAdrian Cockcroft
 
HPC on Azure for Reserach
byJürgen Ambrosi
 
High Performance Computing Pitch Deck
byNicholas Vossburg
 
Fosec2011 keynote address
bythreesixty
 
High Performance Cloud Computing
byDeepak Singh
 
Technology insights: Decision Science Platform
byDecision Science Community
 
Activeeon technology for Big Compute and cloud migration
byActiveeon
 
Enterprise Architecture for NexGen Solutions
byvijaym619610
 
Migliorare la Developer Experience in un mondo Cloud Native
byCommit University
 
Cloud / IFPEN Proactive Case Study - Denis Caromel, Activeon
byParis Open Source Summit
 
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
byAngela Williams
 

More from John Holden

PDF
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
byJohn Holden
 
PDF
NAG software for the Actuarial Community (Sep. 2012)
byJohn Holden
 
PDF
Wilmott Nyc Jul2012 Nag Talk John Holden
byJohn Holden
 
PDF
Numerical Excellence In Finance N A G Jan2010
byJohn Holden
 
PDF
Monte Carlo G P U Jan2010
byJohn Holden
 
PDF
N A G P A R I S280101
byJohn Holden
 
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
byJohn Holden
 
NAG software for the Actuarial Community (Sep. 2012)
byJohn Holden
 
Wilmott Nyc Jul2012 Nag Talk John Holden
byJohn Holden
 
Numerical Excellence In Finance N A G Jan2010
byJohn Holden
 
Monte Carlo G P U Jan2010
byJohn Holden
 
N A G P A R I S280101
byJohn Holden
 

Recently uploaded

PDF
Beyond Basics: How to Build Scalable, Intelligent Imagery Pipelines
bySafe Software
 
PDF
Building a Multi-Tenant OpenShift Platform with HyperShift
byTosin Akinosho
 
PPTX
The power of Slack and MuleSoft | Bangalore MuleSoft Meetup #60
byshyamraj55
 
PPTX
Neo4j Fraud GraphTalk Singapore Nov 2025
bygourisachdeva2
 
PDF
Build an AI/ML-driven image archive processing workflow: Image archive, analy...
bywesley chun
 
PDF
MINDCTI Revenue Release Quarter 3 2025 - Financial Presentation
byMIND CTI
 
PPTX
Redcentric Data Centres: vision, mission and values
byRedcentric
 
PDF
IDSECCONF2025 - Ali - DursGo–Web Security Scanner with AI Analysis.pdf
byidsecconf
 
PDF
SELinux Basics: Managing SELinux Modes and Context - RHCSA+.pdf
byLinuxCert Guru
 
PPTX
Agentic AI presentation with Python Exercises
byParth Mane
 
PDF
How to Spot a Fraudulent Shopping Website
byAshwini Singh
 
PDF
UnityNet AI Induced Harm & Youth Protection Position Statement 2025-11-15
byLHelferty
 
PPTX
How Design Systems and AI Agents Accelerate Product Delivery Sixt
byBoyan Dimitrov
 
PDF
AI in Food Production (Foodwell) - AI Solutions Supporting Operations
bybyteLAKE
 
PDF
Command Line Text Processing - RHCSA +.pdf
byLinuxCert Guru
 
PDF
Mastering UiPath Maestro – Session 2 – Building a Live Use Case - Session 2
byDianaGray10
 
PDF
KMWorld - KM & AI Bring Collectivity, Nostalgia, & Selectivity
byJonathan Ralton
 
PDF
AWS Cloud Technical Essentials - AWS Certificate
byVICTOR MAESTRE RAMIREZ
 
PDF
Supervised Machine Learning Approaches for Log-Based Anomaly Detection: A Cas...
byMohammed BEKKOUCHE
 
PDF
Building Powerful Web Apps to Improve Productivity and Engagement - Esri UK W...
byEsri UK
 
Beyond Basics: How to Build Scalable, Intelligent Imagery Pipelines
bySafe Software
 
Building a Multi-Tenant OpenShift Platform with HyperShift
byTosin Akinosho
 
The power of Slack and MuleSoft | Bangalore MuleSoft Meetup #60
byshyamraj55
 
Neo4j Fraud GraphTalk Singapore Nov 2025
bygourisachdeva2
 
Build an AI/ML-driven image archive processing workflow: Image archive, analy...
bywesley chun
 
MINDCTI Revenue Release Quarter 3 2025 - Financial Presentation
byMIND CTI
 
Redcentric Data Centres: vision, mission and values
byRedcentric
 
IDSECCONF2025 - Ali - DursGo–Web Security Scanner with AI Analysis.pdf
byidsecconf
 
SELinux Basics: Managing SELinux Modes and Context - RHCSA+.pdf
byLinuxCert Guru
 
Agentic AI presentation with Python Exercises
byParth Mane
 
How to Spot a Fraudulent Shopping Website
byAshwini Singh
 
UnityNet AI Induced Harm & Youth Protection Position Statement 2025-11-15
byLHelferty
 
How Design Systems and AI Agents Accelerate Product Delivery Sixt
byBoyan Dimitrov
 
AI in Food Production (Foodwell) - AI Solutions Supporting Operations
bybyteLAKE
 
Command Line Text Processing - RHCSA +.pdf
byLinuxCert Guru
 
Mastering UiPath Maestro – Session 2 – Building a Live Use Case - Session 2
byDianaGray10
 
KMWorld - KM & AI Bring Collectivity, Nostalgia, & Selectivity
byJonathan Ralton
 
AWS Cloud Technical Essentials - AWS Certificate
byVICTOR MAESTRE RAMIREZ
 
Supervised Machine Learning Approaches for Log-Based Anomaly Detection: A Cas...
byMohammed BEKKOUCHE
 
Building Powerful Web Apps to Improve Productivity and Engagement - Esri UK W...
byEsri UK
 

Cloud Task Execution at Scale with example from quant finance

  • 1.
    Experts in numericalsoftware and High Performance Computing Cloud Task Execution at Scale with an example from Quant Finance Microsoft SC18 Theater presentation November 2018 John HOLDEN Mick PONT
  • 2.
    2High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 3.
    3High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 4.
    4High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com ► Manage Distribution (CPU/GPU) ► Manage dependencies ► Manage synchronization ► Manage control ► Manage ad-hoc Grid (during Development) ► Manage Cloud(s) (during Testing / Production)
  • 5.
    5High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com Client Client Client Server Client-Server Client Client Client Client-Worker worker worker worker synchronisation worker worker worker Master Master-Worker
  • 6.
    6High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 7.
    7High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 8.
    8High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com • Origami supports DAGs including: data transfers, metrics, recovery from task failure. • Can run on dev machines, in-house grid, production cloud, CPU, CPU / GPU – mixture.
  • 9.
    9High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 10.
    10High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com Description Elapsed Time Single core ~ 14 hours Origami / Grid / Azure Minutes
  • 11.
    11High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 12.
    12High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk
  • 13.
    13High Performance ComputingConsulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk