Task Engine

Hof’s task engine allows you to write dynamic workflows with CUE. Build modular and composable DAGs that can

• work with files, call APIs, can prompt for user input, and much more
• run scripts and containers, use any language for a custom task
• run a server that calls a workflow per request or bulk process a set of inputs
• create additional task based on the results of other tasks

Hof’s task engine is an extension of cue/flow with

• extra tasks for key-value cache and advanced structural operations on CUE values
• additional control over parallel execution, synchronization of tasks, and message passing
• allows for workflows along side regular CUE files so they can be imported and shared as modules

Overview

Command

run workflows and tasks powered by CUE

Usage:
  hof flow [cue files...] [@flow/name...] [+key=value] [flags]
  hof flow [command]

Aliases:
  flow, f

Available Commands:
  list        print available flows

Flags:
  -B, --bulk string        exprs for inputs to run workflow in bulk mode
  -F, --flow stringArray   flow labels to match and run
  -h, --help               help for flow
  -P, --parallel int       global flow parallelism (default 1)
      --progress           print task progress as it happens

Global Flags:
  ...

Tasks & Schemas

You can find the schema and example for all tasks in the hof/flow reference section

• api
  • Call
  • Serve
• csp (communicating sequential processes)
  • Chan
  • Send
  • Recv
• cue
  • Format (print incomplete to concrete CUE values)
• gen (generate random values)
  • Seed
  • Now
  • Str
  • Int
  • Float
  • Norm
  • UUID
  • CUID
  • Slug
• hof
  • Template (render a hof text/template)
• kv
  • Mem (in-memory cache)
• os
  • Exec
  • FileLock
  • FileUnlock
  • Getenv
  • Glob
  • Mkdir
  • ReadFile
  • ReadGlobs
  • Sleep
  • Stdin
  • Stdout
  • Watch
  • WriteFile
• prompt
  • Prompt (interactive user prompts, like creators)
• st (structural)
  • Mask
  • Pick
  • Insert
  • Replace
  • Upsert
  • Diff
  • Patch

Examples

You can find many examples through hof’s codebase and other projects

• the hof/flow reference section
• the hof/flow test directory
• LLM chat examples
• event and server based processing