Workflow builder

Focus: Master the visual workflow builder to create automated data pipelines with triggers, tasks, and intelligent dependency management. The 5X Jobs workflow builder provides an intuitive visual interface for creating complex data pipelines. Build workflows by connecting triggers and tasks, define execution dependencies, and configure each component to meet your specific requirements.

​

Creating a new job

​

Step 1: Name your job

Start by creating a new job and giving it a descriptive name:

1. Navigate to the Jobs section in your workspace
2. Click ”+ New Job” to create a new workflow
3. Enter a descriptive name for your job in the modal dialog
4. Click “Create job” to proceed to the workflow builder

​

Step 2: Configure job settings

Before building your workflow, configure the basic job settings:

• Job name - Update the job name if needed
• Compute profile - Select the appropriate compute resources (Small, Medium, Large)
• Environment - Choose the environment where this job will execute
• Timeout settings - Set execution time limits if needed
• Concurrent runs - Configure how many instances can run simultaneously

​

Building workflows with triggers

Every job workflow starts with a trigger that determines when and how the pipeline executes.

​

Adding tasks to your workflow

Once you have a trigger, add tasks to define what work your pipeline performs.

​

Managing dependencies and flow

​

Visual dependency management

The workflow builder automatically handles task dependencies:

• Sequential execution - Tasks run in order based on connections
• Parallel execution - Tasks without dependencies run simultaneously
• Conditional flow - Complex branching based on task outcomes
• Error handling - Failed tasks stop dependent execution

​

Best practices for workflow design

Start simple:

• Begin with basic triggers and single tasks
• Test each component before adding complexity
• Use manual triggers for initial development

Design for reliability:

• Add appropriate timeout settings
• Configure concurrent run limits
• Plan for error scenarios and retries

Optimize for performance:

• Use parallel execution where possible
• Select appropriate compute profiles
• Minimize unnecessary dependencies

Maintain clarity:

• Use descriptive names for triggers and tasks
• Document complex workflows
• Keep workflows focused on specific business processes

​

Publishing and testing workflows

​

Draft vs Live versions

5X Jobs supports draft development with live execution:

• Draft changes - Develop and modify workflows without affecting production
• Live execution - Only published workflows execute on schedule
• Safe development - Test changes thoroughly before publishing

​

Publishing workflows

1. Complete your workflow configuration
2. Review all settings and dependencies
3. Click “Publish” to make changes live
4. Monitor the first execution to ensure proper operation

---