From the course: AWS Essential Training for Architects

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

Orchestrating with Step Functions

Orchestrating with Step Functions - Amazon Web Services (AWS) Tutorial

From the course: AWS Essential Training for Architects

Start my 1-month free trial Buy for my team

Orchestrating with Step Functions

“

Orchestration is a common challenge when using automation in your solutions. Orchestration refers to coordinating and managing interconnected tasks to accomplish a specific workflow. Consider the example of a data processing pipeline. It involves multiple steps such as data ingestion, validation, transformation, and storage. Each step requires the use of different AWS services and coordination between them. When orchestrating a solution like this, you may find these challenges: Sequential execution where the solution requires the output of one step to become the input of the next step. Parallel execution, where the solution may need to execute certain steps concurrently to improve performance. Error handling, where each step may encounter issues that need to be handled and may even need a retry logic. Some steps may have timeouts and need to be resumed. And lastly, visibility into the execution of each step to monitor the progress of the pipeline. AWS Step Functions helps address…

Contents