Managing Workflows

This section provides step-by-step instructions for specific tasks.

The torc CLI toolkit provides the simplest mechanism to build and manage workflows. It provides most functionality and this section describes it.

Torc provides a terminal-based management console (run torc tui). Use it view the workflow configurations and check status.

If you need or want more control, you are welcome to use the API through OpenAPI-generated libaries or API tools like curl, Postman, and Insomnia. You can also use Arango tools to manage data directly in the database.

• Configure a workflow
  • Configure a workflow specification
  • OpenAPI Clients
    • Configure with the Python API
    • Configure with the Julia API
  • Startup and completion scripts
  • Compute node configuration options
• Run a workflow
• Check workflow status
  • TUI
  • Monitor events
  • Job status
  • Return codes
• Cancel a workflow
• Restart a workflow
  • Dry run
  • Restarting jobs that did not finish
  • With job dependencies
  • Without job dependencies
  • Restarting jobs with –only-uninitialized
• Automated scheduling
• Gracefully shutdown jobs
• Debugging
  • Log files
    • Compute node log files
    • Results report
  • Slurm error messages
    • Useful grep commands
  • Common Problems
    • Compute nodes exit without pulling jobs
• Passing data between jobs
• Plot Graphs
  • Pre-defined graphs
  • User-defined graphs
• Backups
  • Arango tools
    • Docker container
    • Apptainer container on Kestrel
  • SQLite
  • Workflow Specification
• Archive a Workflow