jobial-io / sclap   1.5.1

GitHub

Scala Command Line Apps Made Simple

Scala versions: 2.13 2.12 2.11

Sclap: Scala Command Line Apps

Continuous Integration Scala version support Codecov

sclap

A simple and effective way to create feature-rich and type-safe Scala command line apps.

An example speaks more than a thousand words:

import io.jobial.sclap.CommandLineApp
import scala.concurrent.duration._
import cats.effect.IO

object PingExample extends CommandLineApp {

  def run =
    for {
      host <- param[String].label("<hostname>").description("The host").required
      count <- opt[Int]("count").description("Number of packets")
      timeout <- opt[Duration]("timeout").default(5.seconds).description("The timeout")
    } yield
      IO(println(s"Pinging $host with count: $count, timeout: $timeout..."))
}

which produces the following usage message when run with --help on a colour terminal:

alt PingExample

If you run it without any arguments, you will get the following on the standard error along with a non-zero exit code, as expected:

> PingExample

Missing required parameter: '<hostname>'
Usage: PingExample [-h] [--count=PARAM] [--timeout=PARAM] <hostname>
      <hostname>        The hostname.
      --count=PARAM     Number of packets.
  -h, --help            Show this help message and exit.
      --timeout=PARAM   The timeout (default: 5 seconds).

If you run it with the argument "localhost", you should get:

> PingExample localhost

Pinging localhost with count: None, timeout: 5 seconds...

Finally, if you specify some options, you will see something like:

> PingExample --count=2 localhost

Pinging localhost with count: Some(2), timeout: 5 seconds...

Try me on Scastie with Scala 3.1.

These examples assume that you have created an alias to your Scala app or wrapped it up in a script so that you can execute it on the command line as PingExample.

A few things to note here:

  • Type safety: Sclap correctly infers the type of each command line option and parameter. For example, count is an Option[Int] because it is not required to be specified by the caller. Host, on the other hand, is a String (not an Option[String]) because it is required. The same way, timeout is a Duration because it has a default value, so it is always available. By being type safe, there is virtually no possibility of ending up with options and parameters in an invalid state. You can be sure your opts and params are always valid and available in your application logic, otherwise Sclap will catch the problem before it reaches your code and handles the error appropriately (for example, it returns an error exit code and prints the error and usage messages).

  • Custom type support: Sclap has built-in support for common argument value types (String, Int, Double , Duration, ...). You can easily add support for further types (or override the defaults) by implementing instances of the ArgumentValueParser and ArgumentValuePrinter type classes (see examples later).

  • The app extends the CommandLineApp trait and has to implement the run function. The result of this function is of type CommandLine[_]. You don't really need to know much about it though: as long as you implement your run function in this format, it will return the right type and Sclap will be able to interpret your CLI.

  • In the yield part of the for {...}, you can return pretty much anything, Sclap will know how to deal with it, including error handling. You might have noticed though that the return type of the yield block is actually always an IO[_]. If you are not familiar with the IO monad, all you need to know about it is that your application logic has to be enclosed in an IO ('lifted' into an IO context) before it is returned in the yield part of the for comprehension in the run function. If your application logic results in something other than an IO, it gets implicitly 'lifted' into an IO[_] context. For example, if yield has code that returns an Int, it will implicitly become IO[Int], taking care of any exceptions potentially thrown in the process. Also, if yield results in a Future, Try or an Either[Throwable, _], Sclap will know how to lift them into an IO[_] context in a safe (referentially transparent) way, propagating and handling errors automatically. The IO context guarantees that your application logic will only run once the arguments have been parsed and validated safely.

  • Sclap will handle errors returned by your application code automatically: if your app throws an exception (or returns an error state in an IO, ZIO, Future or Try), it will automatically be turned into a non-zero exit code. Alternatively, you can return an IO[ExitCode] to explicitly specify the exit code (see cats.effect.ExitCode in Cats Effect).

Introduction

Sclap is a purely functional, type safe, composable, easy to test command line argument parser for Scala. Command line is still king and writing command line tools should be straightforward and painless.

Although Sclap is built on Cats, Cats Effect and Cats Free in a purely functional style and combines best with the Cats ecosystem, you don't need to know any of those libraries to use it. Sclap can be seamlessly used in non-Cats based or non-FP applications as well. It comes with:

  • Automatic, fully customizable usage help generation
  • Type safe access to command line options and parameters in your application code
  • Support for custom type arguments
  • ANSI colours
  • Bash and ZSH autocomplete script generation
  • Subcommand support, with support for composable, nested, hierarchic interfaces
  • Straightforward, composable, purely functional, referentially transparent CLI description
  • Extendable API and implementation, with parser implementation decoupled from DSL
  • Flag, single-value and multiple value options
  • POSIX-style short option names (-a) with grouping (-abc)
  • GNU-style long option names (--opt, --opt=val)

The motivation is to help promote Scala as an alternative to implementing command line tools as scripts and to make it easier to expose existing functionality on the command line. Writing CLI tools should be a very simple exercise and Scala today is a better language for the task than most others (including scripting languages). Sclap aims to provide a well maintained and stable library that is feature rich enough to cover all the modern requirements.

A very basic example...

import io.jobial.sclap.CommandLineApp
import cats.effect.IO

object HelloExample extends CommandLineApp {

  def run =
    for {
      hello <- opt[String]("hello")
    } yield
      IO(println(s"hello $hello"))

}

which produces the following usage help:

> HelloExample --help

Usage: HelloExample [-h] [--hello=PARAM]
  -h, --help          Show this help message and exit.
      --hello=PARAM

or

> HelloExample --hello=world

hello Some(world)

You can find this example along with many other more complex ones here.

To use Sclap you need to add

libraryDependencies ++= Seq(
  "io.jobial" %% "sclap" % "2.0.0"
)

to your build.sbt or

<dependency>
    <groupId>io.jobial</groupId>
    <artifactId>sclap_${scala.version}</artifactId>
    <version>2.0.0</version>
</dependency>

to pom.xml if you use Maven, where scala.version is either 2.12 or 2.13. For Scala 2.11, use 1.4.0.

...and a more detailed one

...

which produces the usage:

...

Positional parameters and options

Command header and description

import io.jobial.sclap.CommandLineApp
import cats.effect.IO

object HelloWorldExample extends CommandLineApp {

  def run =
    command.header("Hello World")
      .description("A hello world app with one option.") {
        for {
          hello <- opt[String]("hello").default("world")
        } yield
          IO(println(s"hello $hello"))
      }
}

which produces the usage help:

> HelloWorldExample --help

Hello World
Usage: HelloWorldExample [-h] [--hello=PARAM]
A hello world app with one option.
  -h, --help          Show this help message and exit.
      --hello=PARAM   (default: world).

Subcommands

Sclap supports subcommands naturally by nesting command specs. Let's say we want to define a command line interface to add or subtract two numbers:

import io.jobial.sclap.CommandLineApp
import cats.effect.IO

object ArithmeticExample extends CommandLineApp {

  def add =
    for {
      a <- param[Int].required
      b <- param[Int].required
    } yield IO(a + b)

  def sub =
    for {
      a <- param[Int].required
      b <- param[Int].required
    } yield IO(a - b)

  def run =
    for {
      addResult <- subcommand("add")(add)
      subResult <- subcommand("sub")(sub)
    } yield for {
      r <- addResult orElse subResult
    } yield IO(println(r))
}
> ArithmeticExample --help

Usage: ArithmeticExample [-h] [COMMAND]
  -h, --help   Show this help message and exit.
Commands:
  add
  sub

and

> ArithmeticExample add --help

Usage: ArithmeticExample add PARAM PARAM
  PARAM
  PARAM

so we can

> ArithmeticExample add 3 2
5
> ArithmeticExample sub 3 2
1

The structure of a subcommand is the same as of a main command. Commands can be arbitrarily combined into a hierarchy of subcommands using the subcommand(...) function. Since everything is referentially transparent here, subcommand and command definitions can be reused and combined arbitrarily, without any side-effect.

This can be demonstrated by improving on the arithmetic example the following way. Let's say we want to implement division and multiplication in addition to the previous operations. Since all these require two operands and only differ in the operator, it would be redundant to implement them as separate functions. Instead, the code for the subcommands can be shared the following way, for example:

def operation[T: ArgumentValueParser](name: String, op: (T, T) => T) =
  subcommand[T](name) {
    for {
      a <- param[T].required
      b <- param[T].required
    } yield IO(op(a, b))
  }

def run =
  for {
    subcommandResult <- subcommands(
      operation[Double]("add", _ + _),
      operation[Double]("sub", _ - _),
      operation[Double]("mul", _ * _),
      operation[Double]("div", _ / _)
    )
  } yield subcommandResult.map(println)

As can be seen from this example, the code for the subcommands has been completely generified: both the operand type and the operators are parameters here. Since the type is a parameter now, we need to make sure there is an ArgumentValueParser instance available for it to be able to use it in param[...]. Another thing to note is that Sclap provides a useful alternative to orElse when it comes to combining the results of the subcommands. The subcommands(...) function takes a variable number of subcommand definitions as arguments, and returns the result of the one selected by the caller (just like as if orElse was used between the individual subcommand results). This is useful because the selection of the subcommand result can be moved to the main for comprehension, without introducing another one in the yield section (see previous example).

We can now:

> ArithmeticExample mul 3 2
6
> ArithmeticExample div 3 2
1.5

To further improve our arithmetic app, we can add headers and description to the main command and the subcommands like this:

def operation[T: ArgumentValueParser](name: String, op: (T, T) => T) =
  subcommand[T](name)
    .header(s"${name.capitalize} two numbers.")
    .description("Speficy the two operands and the result will be printed.") {
      for {
        a <- param[T].description("The first operand.").required
        b <- param[T].description("The second operand.").required
      } yield IO(op(a, b))
    }

def run =
  command("arithmetic")
    .header("Simple arithmetics on the command line.")
    .description("Use the following commands to add, subtract, multiply, divide numbers.") {
      for {
        subcommandResult <- subcommands(
          operation[Double]("add", _ + _),
          operation[Double]("sub", _ - _),
          operation[Double]("mul", _ * _),
          operation[Double]("div", _ / _)
        )
      } yield subcommandResult.map(println)
    }

Error handling

As explained before, your run function (either explicitly or implicitly) always takes this format:

import cats.effect.IO

def run =
  for {
    _ <- opt(...)
  } yield IO {
    // app code
  }

If the IO results in an error state, the default error handling is to print the error message and return a non-zero exit code:

import cats.effect.IO
import io.jobial.sclap.CommandLineApp

object ErrorExample extends CommandLineApp {

  def run =
    for {
      hello <- opt[String]("hello").default("world")
    } yield
      IO.raiseError(new RuntimeException("an error occurred..."))

}
> ErrorExample
an error occurred...

What if my code throws Exceptions?

Since the application code in yield is always wrapped in an IO, an exception will result in an IO with an error state exactly the same way as above:

import io.jobial.sclap.CommandLineApp
import cats.effect.IO

object ExceptionExample extends CommandLineApp {

  def run =
    for {
      hello <- opt[String]("hello").default("world")
    } yield IO {
      throw new RuntimeException("an error occurred...")
    }

}

should execute like

> ExceptionExample
an error occurred...

with a non-zero exit code. However, if you call it with --help, the application code will never run and the exception doesn't get thrown, as you would expect:

> ExceptionExample --help
Usage: ErrorExample [-h] [--hello=PARAM]
  -h, --help          Show this help message and exit.
      --hello=PARAM

Using with ZIO

Sclap can be used seamlessly with ZIO through ZIO's cats-interop. Sclap also provides the more convenient ZIOCommandLineApp base trait:

libraryDependencies ++= Seq(
  "io.jobial" %% "sclap-zio" % "1.2.1"
)

and then

import io.jobial.sclap.zio.ZIOCommandLineApp
import zio.console._

object ZIOExample extends ZIOCommandLineApp {

  def run =
    for {
      hello <- opt[String]("hello")
    } yield putStr(s"Hello $hello")
}

What if I want to use Future?

You can return a Future seamlessly in the yield part of the run function:

import concurrent.Future

def run =
  for {
    hello <- opt[String]("hello").default("world")
  } yield Future {
    println(s"hello $hello")
  }

It should produce:

> HelloExample

hello world

Of course, the Future gets executed only if Sclap could parse the arguments successfully and help is not requested.

Errors are handled as expected:

import concurrent.Future

def run =
  for {
    hello <- opt[String]("hello").default("world")
  } yield Future {
    throw new RuntimeException("there was an error...")
  }

should run like

> HelloExample
there was an error...

with a non-zero exit code.

How about returning a Try or an Either?

You can return a Try or an Either as well:

import util.Try

def run =
  for {
    hello <- opt[String]("hello").default("world")
  } yield Try {
    println(s"hello $hello")
  }
import util.Either

def run =
  for {
    hello <- opt[String]("hello")
  } yield hello match {
    case Some(hello) =>
      Right(hello)
    case None =>
      Left(new IllegalArgumentException("wrong argument"))
  }

The behaviour is the same as for Future.

Custom type arguments

Argument values are handled type safely in Sclap. Parsing and printing arguments of different types are done through the ArgumentValueParser and ArgumentValuePrinter type classes.

An example for parsing a command line option of type LocalDate:

import io.jobial.sclap.CommandLineApp
import io.jobial.sclap.core.{ArgumentValueParser, ArgumentValuePrinter}
import java.time.LocalDate
import scala.util.Try
import cats.effect.IO

object DateExample extends CommandLineApp {

  implicit val parser = new ArgumentValueParser[LocalDate] {
    def parse(value: String) =
      Try(LocalDate.parse(value)).toEither

    def empty: LocalDate =
      LocalDate.now
  }

  implicit val printer = new ArgumentValuePrinter[LocalDate] {
    def print(value: LocalDate) =
      value.toString
  }

  def run =
    for {
      d <- opt[LocalDate]("date").default(LocalDate.now).description("The date")
    } yield
      IO(println(s"date: $d"))
}

Instead of defining the printer directly, it can be derived from a Show intance. So the following would also work as a way to derive the argument value printer for LocalDate, for example:

  implicit val localDateShow = Show.fromToString[LocalDate]

Accessing the full argument list

If for some reason you need to access all the arguments as they were passed on the command line, you can use the args function:

def run =
  for {
    a <- args
  } yield
    IO(println(a)) // a is a Seq[String] with all the arguments

Customizing the usage help format

Overriding the app name

The name of the app printed in the usage help is derived from the main class name by default. It can be overridden by using either the syntax

def run =
  command(name = "my-app").description("My really cool app.") {
    for {
      o <- opt(...)
    } yield
    ...
  }

or by setting the app.name system property:

java -Dapp.name=my-app ...

Generating a Bash or ZSH autocomplete script

...

Testing your app

Sclap comes with the CommandLineAppTestHelper trait to help you write tests against your CLI specs:

List of examples

You can find more examples here.

How does it work?

Anatomy

A few pointers on the structure of the command line description in Sclap. An application typically implements the CommandLineApp trait, which provides a safe implementation of the main function relying on Cats Effect's IOApp. The app has to implement the

def run: CommandLine[Any]

function, which expands to

def run: CommandLineArgSpec[IO[Any]]

which in turn is the same as

def run: Free[CommandLineArgSpecA, IO[Any]]

The typical structure of a run function is

def run =
  for {
    o <- opt(...)
    ...
  } yield IO {
    ...
  }

which is just a monadic expression using the CommandLineArgSpec Free monad from above. The for part of the comprehension binds the option and parameter values to names, and the yield section returns the application logic. As mentioned before, the return type of the yield part is always IO[_]. This is important: IO is pure and allows the library to process the description safely, without any side-effects. To make it more convenient for applications that do not use Cats Effect, Sclap provides safe implicits to lift other common return types (Future, Try or Either) into an IO context in a referentially transparent way (of course, the rest of your code will not become referentially transparent).

No macros used or animals harmed in the making of Sclap.

Modules

Sclap is modular and comes with the following artifacts:

  • sclap-core: defines the DSL, built on cats-free and cats-effect; the DSL is implementation independent, leaving it open for alternative parser implementations and making it future proof in case the default parser impl (which currently uses Picocli) becomes obsolete or unmaintained. An implementor has to implement the executeCommandLine function which takes the CommandLine description along with the command line args as arguments.
  • sclap-app: provides the CommandLineApp trait and other helper functionality.
  • sclap-picocli: the default Sclap parser implementation built on Picocli, which is a mature command line parsing library with a traditional, non-safe Java API. Fortunately it comes with no dependencies apart from the Java standard library and exposes a fairly reusable API.
  • sclap-zio: ZIO support.
  • sclap-examples: Example apps.

Sclap relies on the Free monad class from cats-free to implement the DSL that describes the command line interface. The DSL is used in two phases: the first pass builds the command line interface structure, which is then used in a second pass to parse the actual arguments passed to the app and bind the results to the values in the monadic expression, or to generate the command line usage text in case of a failure or if --help is requested. The application logic is represented as an IO monad, which comes from cats-effect. By describing the application logic in a referentially transparent manner, it is possible to evaluate the command line description multiple times without any side effects ( like running actual application logic, for example).

Implicits

Sclap relies on a few carefully designed implicits to make the syntax more concise. If you want to override the defaults or have an aversion to implicits, you can always choose to not include the built-in implicits in your code by extending the CommandLineAppNoImplicits trait instead and cherry-pick the ones you need separately. If you decide not to use any of the implicits provided by the library, the syntax becomes slightly more verbose but still manageable. Here is an example:

...

Implementation dependent extensions

If you need to access the implementation specific features in Picocli for whatever reason, the sclap-picocli module provides extensions to Opts and Params that allow access to the underlying Builder instances directly, for example:

opt(...).withPicocliBuilder(_.hidden(true))