Scala
These jobs enable rapid prototyping, quick transformations, testing logic, and performing Spark operations without compiling a JAR. Raw Scala jobs allow users to run inline Scala code or upload Scala scripts directly. You'll reach it from the Create Job form via Job Type → Custom Code → Language → Raw Scala.
Required Fields
| Field | Required | Notes |
|---|---|---|
| Cluster | - | Target cluster for execution |
| Job Type | Yes | Custom Code |
| Language | Yes | Raw Scala |
| Path | Yes | Scala script location, selected with Choose file |
| Arguments | No | Arguments passed to the script |
Advanced Options
An Append checkbox plus six dependency tabs:
| Tab | Purpose |
|---|---|
| Configs | Spark configuration Key / Value rows (with Bulk Edit) |
| Packages | Add external libraries |
| Jars | Add external dependencies |
| Repositories | Specify dependency sources |
| Archives | Include archive files |
| Files | Attach supporting files |
Followed by Principal & Key Tab, Driver Config, Concurrent Runs and Timeout. See Create Job.
When to Use Raw Scala
We recommend Raw Scala jobs for:
- Quick debugging
- Developing Spark logic
- Experimentation before converting to JAR jobs