p0

6 ms·

1. 1.▲
   by p0 1y ago

   How does this compare to the BPE crate [1]? Its main selling point is support for incrementally re-tokenising text, but it's also faster than tiktoken. [1] https://crates.io/crates/bpe
2. 2.▲
   by p0 5y ago

   Check out https://cs.github.com/about/syntax -- indeed, by default terms are searched in both content and paths. You can restrict to one or the other with `content:` or `path:`.
3. 3.▲
   by p0 5y ago

   You could do this with `-path:docs/` (or `NOT path:docs/`).