jade
Home page
API reference
jade.cli
jade.common
jade.enums
jade.events
jade.exceptions
jade.extensions
jade.hpc
jade.jobs
jade.loggers
jade.models
jade.resource_monitor
jade.result
jade.spark
jade.test_common
jade.utils
Contents:
Installation
Computer or HPC with conda
Computer with docker
Quick Start Guide
Configure Jobs
Submit Jobs
Job Status
Job Results
Tutorial
CLI Commands
HPC Configuration
Configure Jobs
CLI Execution
Job Execution
Job Status
Canceling Jobs
Job Results
Failed or Missing Jobs
HPC Job information
Debugging
Resource Monitoring
Results Queries
Show available tables
View job results
View all CPU and memory usage by each job
View maximum CPU and memory usage by each job
View successful job runtimes in hours along with per-job resource utilization
Frequently Asked Questions
JADE Configuration
Main Level
Per-Job Definition
Submission Group Behaviors
Job Submission Strategies
Independent, short, multi-core jobs
Independent, short, single-core jobs
Independent, single-core jobs with variable runtimes
Jobs that require different submission parameters
Jobs that require multiple nodes
Batch Pipeline
Create the pipeline
Customize the config
Submit the pipeline
Check status
Example
Spark Jobs
Setup
Run scripts manually
Run a Jupyter server
Run a Jupyter notebook on an existing cluster
Use nodes with Nvidia GPUs
Debugging Problems
Compute Node Resource Monitoring
Start a Spark Cluster on Arbitrary Compute Nodes
Singularity Containers
Building a container that can be used for HPC submissions
Running a container that includes JADE
Distributed Submission Workflow
Advanced Usage
Extending JADE
Generic Command Extension
Demo Extension
Post-process
Dev & Reference
jade
JADE Design
JADE Classes
Building the Documentation
Build locally
Push to GitHub
jade
jade
jade.spark
View page source
jade.spark
ΒΆ
metrics
Generates metrics from a Spark cluster.