Rekihyt / Sifu

A concatenative, pattern-match oriented language based on tries.

Sifu, A Concatenative Language Based on Tries

See some examples here: https://sifu-lang.pages.dev/playground

---

Main Ideas

• Computation is a pattern match

• No turing completeness, everything terminates by matching entries whose index in the map is less than (or recursive/equal, but with structural simplification) until a fixed point (any remaining indices contain no more matches).

• Everything is a pattern map (like tries, but lookups have to deal with sub-lookups)

• Core language is pattern-matching rewriter

  • pattern entries (->) and pattern matches (:)
  • keywords are ->, :, ,, (), and {}
  • keywords have lower precedence versions: -->, ::, ;,
  • match / set membership / typeof is the same thing (:)
  • source files are just triemaps with entries separated by newlines
  • any characters are valid to the parser (punctuation chars are values, like in Forth)
  • code can be quoted with backticks (```) like in Lisps, to treat it as data instead of evaluating it.
  • values are literals, i.e. upper-case idents, ints, and match only themselves
  • vars match anything (lower-case idents)

• Stdlib functions

  • multi entries (=>) and multi triemap matches (::). These are implemented by continuously appending a single var match of the current scope until the top of the scope is reached (each key in the pattern is matched)

• Values and Variables

  • variables are just entries x -> 2 and match anything
  • values are as well Val1 -> 2 and are treated as literals (strings are just an escaped value)

• Emergent Types

  • types are triemaps of values
  • records are types of types
  • record fields are type level entries
  • hashmaps of types can be used to implement row types
  • type checking is a pattern match
  • dependent types are patterns of types with variables

• Compiler builds on the core language, using it as a library

  • complilation is creating perfect hashmaps from dynamic ones

Roadmap

Core Language

• Parser/Lexer

  • Lexer (Text → Token)
  • Parser (Tokens → AST)
    • Non-recursive parsing
    • Newline delimited apps for top level and operators' rhs
    • Nested apps for parentheses
    • Patterns
    • Infix
    • Match
    • Arrow
    • Syntax
      • Apps (parens)
      • Patterns (braces)

• Patterns

  • Definition
  • Construction (AST → Patterns)
    • Error handling
  • Matching
    • Vals
    • Apps
    • Vars
    • Multi

Sifu Interpreter

• REPL

  • Add entries into a global pattern
  • Update entries
  • Load files
  • REPL specific keywords (delete entry, etc.)

• Effects / FFI

  • Driver API
  • Builtin Patterns
  • File I/O

• Basic Stdlib using the Core Language

• Sifu Compiler

  • Effects / FFI

    • Effect analysis
      • Tracking
      • Propagation
    • User error reporting

  • Type-checking

  • Codegen

    • Perfect Hashmaps / Conversion to switch statements

---

Implementation FAQ

If the ASTs are hashable, why not use a hashmap instead of a trie of tries?

Hashmaps or tries would work for inserting, but granular matching wouldn't. Matching variables would also be tricky to implement.

---

Thanks to Luukdegram for giving me a starting point with their compiler Luf