Downloaded 164 times
![@AnimeshSingh
Actions: Multi-runtime support, e.g. SwiftA
func main(params:[String:Any]) -> [String:Any] {
var reply = [String:Any] ()
if let name = params[“name”] as? String {
print(“Hello (name)”)
reply[“msg”] = “Goodbye (name)”
}
return reply
}
Programming model](https://image.slidesharecdn.com/serverlessopenwhiskiotcloudexpo-161103172758/75/How-to-build-a-Distributed-Serverless-Polyglot-Microservices-IoT-Platform-using-Docker-and-OpenWhisk-23-2048.jpg)
![@AnimeshSingh
Actions: Multi-runtime support, e.g. SwiftA
func main(params:[String:Any]) -> [String:Any] {
var reply = [String:Any] ()
if let name = params[“name”] as? String {
print(“Hello (name)”)
reply[“msg”] = “Goodbye (name)”
}
return reply
}
Programming model](https://crownmelresort.com/image.slidesharecdn.com/serverlessopenwhiskiotcloudexpo-161103172758/75/How-to-build-a-Distributed-Serverless-Polyglot-Microservices-IoT-Platform-using-Docker-and-OpenWhisk-23-2048.jpg)
Uploaded byAnimesh Singh
How to build a Distributed Serverless Polyglot Microservices IoT Platform using Docker and OpenWhisk
The document discusses the evolution of cloud computing, focusing on building a distributed serverless IoT platform using OpenWhisk and Docker. It highlights the advantages of serverless computing, such as cost efficiency and easier application development, while detailing the programming model and architecture of OpenWhisk. Additionally, it explores the integration of OpenWhisk with MQTT and Node-RED for creating serverless applications in IoT environments.
More Related Content
Similar to How to build a Distributed Serverless Polyglot Microservices IoT Platform using Docker and OpenWhisk
![Hybrid Cloud, Kubeflow and Tensorflow Extended [TFX]](https://cdn.slidesharecdn.com/ss_thumbnails/tfx-kfp-191031073013-thumbnail.jpg?width=640&height=640&fit=bounds)
How to build a Distributed Serverless Polyglot Microservices IoT Platform using Docker and OpenWhisk
- 1. Animesh Singh STSM IBMCloud Platform Cloud Expo, Santa Clara, November 2016 @AnimeshSingh How to build a Distributed Serverless Polyglot Microservices IoT Platform using Docker and OpenWhisk
- 2. @AnimeshSingh Cloud Computing Evolution BareMetal IaaS Container Orchestrators PaaS
- 3. @AnimeshSingh Problem: It’s expensiveto scale microservices, even on a PaaS Explosion in number of containers / processes: 1. Increase of infrastructure cost footprint 2. Increase of operational management cost and complexity Region B Region A Break-down into microservices Make each micro service HA Protect against regional outages Monolithic application
- 4. @AnimeshSingh Problem: the programmingand cost model doesn’t help • Continuous polling needed in the absence of an event driven programming model. • Charged for resources, even when idle. • Worries persist about capacity management. Swift Application Container VM CF 2 Polling 1b Request 1a
- 5. @AnimeshSingh Bare Metal IaaS Container Orchestrators PaaS EnterServerless! Serverless
- 6. @AnimeshSingh a cloud-native platform for short-running,stateless computation and event-driven applications which scales up and down instantly and automatically and charges for actual usage at a millisecond granularity event handlersevents What is Serverless?
- 7. @AnimeshSingh Why is Serverlessattractive? 7 Short answer: Besides a) making app development & ops dramatically faster, cheaper, easier (but different J ), it b) Drives infrastructure cost savings (yes – this has been true for most IT innovations over the last decades, while serverless potentially introduces another step-function change)
- 8. @AnimeshSingh Key factors forinfrastructure cost savings Traditional models (CF, containers, VMs) Serverless High Availability At least 2-3 instances of everything No incremental infrastructure Multi-region deployment One deployment per region No incremental infrastructure Cover delta between short (<10s) load spikes and valleys (vs average) ~2x of average load No incremental infrastructure Example incremental costs 2 instances x 2 regions x 2 = 8x 1x 8
- 9. @AnimeshSingh What is Serverlessgood for? 9
- 10. Introducing OpenWhisk, a fabricand platform for the serverless, event driven programming model
- 11. @AnimeshSingh What is OpenWhisk? anopen Beta offering in IBM’s Bluemix cloud
- 12. @AnimeshSingh What is OpenWhisk? anopen-source project on github
- 13. @AnimeshSingh Build your apps,your way. Use a combination of the most prominent open-source compute technologies to power your apps. Then, let Bluemix handle the rest. Ease of getting startedFull stack Control FunctionsPaaSContainersIaaS What is OpenWhisk? another way to build apps….
- 14. @AnimeshSingh What is OpenWhisk? adistributed compute service to execute application logic in response to events.
- 15. @AnimeshSingh OpenWhisk: How doesit work? Incoming HTTP request, e.g. HTTP GET openwhisk.ng.bluemix.net/api/v1/<namespace>/actions/getCustomers 1 Browser Mobile App Web App OpenWhisk 2 Invoke associated OpenWhisk action „getCustomers“ Swift! DockerJS! Python! Java*! Variety of languages * work in progress
- 16. @AnimeshSingh OpenWhisk: How doesit work? - API Gateway takes care of… - security (authenticate, authorize, threat protect, validate) - control (rate limiting, response caching) - mediation - parameter mapping - schema validation - … and supports e.g. different verbs (Get, Post, Put, Delete, …) Incoming HTTP request, e.g. HTTP GET api-gw.mybluemix.net/…/getCustomers 1 Browser Mobile App Web App APIGateway 2 OpenWhisk 3 Invoke associated OpenWhisk action „getCustomers“ Swift! DockerJS! Python! Java*! * work in progress Coming soon...
- 17.
- 18. What is OpenWhisk? ahigh-level serverless programming model Trigger Rule Action Package
- 19. What is OpenWhisk? ahigh-level serverless programming model Trigger Rule Action Package language support to encapsulate, share, extend code first-class event-driven programming constructs first-class functions compose via sequences docker containers as actions all constructs first-class — powerful extensible language
- 20. @AnimeshSingh Trigger: A classof events that can happenT Programming model
- 21. @AnimeshSingh Actions: An event-handler,i.e. code that runs in response to an event A Programming model
- 22. @AnimeshSingh Programming model Actions: Multi-runtimesupport, e.g. JavaScriptA function main(msg) { return { message: 'Hello, ' + msg.name + ' from ' + msg.place }; };
- 23. @AnimeshSingh Actions: Multi-runtime support,e.g. SwiftA func main(params:[String:Any]) -> [String:Any] { var reply = [String:Any] () if let name = params[“name”] as? String { print(“Hello (name)”) reply[“msg”] = “Goodbye (name)” } return reply } Programming model
- 24. @AnimeshSingh Actions: In anyother language by packaging with Docker A Programming model
- 25. @AnimeshSingh Rules: An associationof a trigger and an actionR R := T A Programming model
- 26. @AnimeshSingh Actions: Can bechained to create sequences to increase flexibility and foster reuse A AA := A1 + A2 + A3 AB := A2 + A1 + A3 AC := A3 + A1 + A2 Programming model
- 27. @AnimeshSingh Packages: A sharedcollection of triggers and actionsP A A read write T changes A translate A forecast A post T topic Open Source A myAction T myFeed Yours T commit Third Party Programming model
- 28.
- 29.
- 30. @AnimeshSingh Edge! VM! Edge! VM! ! Edge! ! ! ! ! Edge! VM! Edge! VM! Master! ! ! ! ! ! ! ! ! controller Edge! VM! Edge! VM! ! Slave! ! ! ! ! ! ! ! ! ! ! invoker • microservices deployedin docker containers! • open-source system middleware! • NoSQL (CouchDB) persistence! action container! action container! action container! action container! action container! action container! action container! action container OpenWhisk Open Source Core Runtime
- 31.
- 32. @AnimeshSingh controller invoker Deploying and managing traditionalmicroservices 1 Why Docker?
- 33. @AnimeshSingh Slave VM Lightweight isolatedexecution environment for arbitrary user code action container action container action container action container action container action container action container action container 2 Why Docker?
- 34. @AnimeshSingh Portable description ofarbitrary binary user actions (Dockerfile) Docker file 3 Why Docker?
- 35. @AnimeshSingh % wsk actioninvoke hello in 8 easy steps How it all works? POST /api/v1/namespaces/myNamespace/actions/myAction
- 36.
- 37.
- 38. @AnimeshSingh OpenWhisk: Usage ofDocker • Isolation of actions • Control over consumed resources of each container 38 A = wsk action invoke docker run ≈
- 39. @AnimeshSingh OpenWhisk: Container startup 39 Startcontainer docker run Initialize /init Run /run cold container
- 40. @AnimeshSingh Start container docker run Initialize /init Run /run OpenWhisk:Container startup 40 pre-warmed container
- 41. @AnimeshSingh Start container docker run Initialize /init Run /run OpenWhisk:Container startup 41 warm container
- 42. @AnimeshSingh OpenWhisk: Container startupoptimization • Performance is king. 42 cold container pre-warmed container warm container faster
- 43.
- 47.
- 48.
- 49.
- 50. @AnimeshSingh MQTT NODES INNODE-RED
- 51.
- 52.
- 53. OpenWhisk Feeds and creatingMQTT feeds
- 54. @AnimeshSingh Trigger Action Action Action push, fork, comment,.. CUSTOM FEED EXAMPLE
- 55. @AnimeshSingh anybody can createa Package with a feed /whisk.system/github /mynamespace/github
- 56. MQTT feeds forOpenWhisk • Bridging MQTT messages to OpenWhisk Actions can be achieved by creating a new Feed provider. This provider would subscribe to message topics and execute registered Triggers with incoming messages. • The custom feed provider would need to establish and maintain long-lived MQTT connections, waiting for messages to arrive. This requirements means the Feed provider needs an external service to handle managing these connections, it won’t be possible within the Feed Action. • This feed provider service is implemented using Node.js, using Cloudant for the database. The service listens for HTTP requests, with Trigger registration details, from the Feed Action. The Node.js MQTT library is used to subscribe to registered topics. When messages are received, the OpenWhisk client library is used to invoke the Trigger remotely, passing the message contents as event parameters. • This service provider is packaged using Docker. Pushing this image into the IBM Containers registry, the Feed provider can be started on IBM Bluemix using the Containers service. http://jamesthom.as/blog/2016/06/15/openwhisk-and-mqtt/
- 57. MQTT feeds forOpenWhisk • This service provider is packaged using Docker. • Pushing this image into the IBM Containers registry, the Feed provider can be started on IBM Bluemix using the Containers service.
- 58.
- 59.
- 60. @AnimeshSingh Node-RED and OpenWhisk • Community effort to integrate with open tools: NodeRED • NodeRED is all about automating flows to orchestrate calls to different service APIs • Usually triggered by calls from external systems or devices • Runs within a long-running single node process, with a dedicated amount of CPU & memory being allocated • OpenWhisk is all about executing code (custom logic) in response to events on a scalable platform, with a dedicated amount of CPU & memory being allocated per-request • NodeRED and OpenWhisk complement each other • Use NodeRED to graphically create flows, automating a series of tasks in a kind of workflow • Use OpenWhisk to execute custom logic (requiring some kind of CPU- or memory bound operation) triggered from within NodeRED
- 61. @AnimeshSingh • Use Node-REDto create Multi cloud Serveless Applications! Use Node-RED to compose Serverless Applications $ wsk property set --apihost openwhisk.ng.bluemix.net --auth 96294c7b- e6f4-4ccf --namespace “animeshsingh" $ wsk action invoke /whisk.system/utils/ echo -p message hello --blocking --result { "message": "hello" }
- 62. @AnimeshSingh Devices Node-RED & OpenWhisk MQTT BrokerTrigger Action Action Action Bringing it all together – Serverless IoT Applications
- 63.
- 64. @AnimeshSingh What you learnedtoday • We’re in the early days of an evolution that is empowering developers to write cloud native applications better, faster, and cheaper • OpenWhisk provides an open source platform to enable cloud native, serverless, event driven applications • OpenWhisk, MQTT and Node-RED can be used together to create IoT Serverless applications
- 65. @AnimeshSingh Experiment with OpenWhiskon Bluemix bit.ly/ow-bm
- 66. @AnimeshSingh Join us tobuild a cloud native platform for the future! OpenWhisk.org dwopen.slack.com #openwhisk bluemix.net OpenWhisk and MQTT http://jamesthom.as/blog/2016/06/15/openwhisk-and-mqtt/
- 67.