Evan-Almloff

6 ms·

1.
by Evan-Almloff 1y ago
> Because WebAssembly modules lack direct access to the DOM, they rely on an additional JavaScript interoperability layer, which can introduce extra overhead. Blazor is slow for other reasons. You can make wasm web frameworks fast (see l
2.
by Evan-Almloff 1y ago
Most of the optimizations apply equally to calling into webview JS from a native application for something like dom manipulation. There is a wry example that uses the system webview in the repo: https://github.com/ealmloff&#
3.
by Evan-Almloff 1y ago
The two projects have different usecases so they can't be directly compared. Slegehammer bindgen makes calling javascript from rust faster in the browser. Wasmtime is a native runtime for WASM outside of the browser
4.
Kalosm 0.4: ergonomic local and remote transformer inference in Rust(floneum.com)
2 points by Evan-Almloff 2y ago|0 comments
5.
by Evan-Almloff 2y ago
There are several good community component libraries now. daisy rsx is one that is already updated with 0.6 support: https://crates.io/crates/daisy_rsx
6.
by Evan-Almloff 2y ago
Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for: - Whisper for audio transcription - Llama, phi and mistral models for text generation. - Structured generation: You can generate text that f
7.
Kalosm 0.3: A Rust framework for local AI(floneum.com)
1 points by Evan-Almloff 2y ago|1 comments
8.
Structured Generation Visualized(floneum.com)
1 points by Evan-Almloff 2y ago|0 comments
9.
by Evan-Almloff 2y ago
It is pretty good. I am working on an application that uses SVGs as a way to draw a workflow editor UI with Dioxus: https://github.com/floneum/floneum
10.
by Evan-Almloff 2y ago
We have a web components example here: https://github.com/DioxusLabs/dioxus/blob/fd21c971038840130f... Everything should work like normal except: attributes are not typed, custom event listeners must be imple
11.
by Evan-Almloff 2y ago
All data you insert into a generational box needs to be allowed to last for the 'static lifetime (have no internal temporary pointers). You cannot insert something like &'a str into a generational box
12.
by Evan-Almloff 2y ago
Dioxus web compiles to WASM, but we compile to native code for desktop rendering to make it easier to interact with native APIs like the filesystem. We just use the web browser for rendering
13.
by Evan-Almloff 2y ago
We are copying the reference to the data, not the data itself. The reference to the data lasts for the lifetime of the program. Generational box lets you insert data that last for shorter than the lifetime of the program (as long as that da
14.
by Evan-Almloff 3y ago
I would love to integrate llava in the future!
15.
by Evan-Almloff 3y ago
Yes, you can set the source to any local file instead of a huggingface model. Here is a example: https://gist.github.com/ealmloff/3398d172180fa783f043b4a2696...
16.
Show HN: Kalosm an embeddable framework for pre-trained models in Rust(floneum.com)
66 points by Evan-Almloff 3y ago|7 comments
17.
by Evan-Almloff 3y ago
It's here: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2
18.
Show HN: Kalosm – a local first AI meta-framework in Rust(github.com)
4 points by Evan-Almloff 3y ago|0 comments
19.
Floneum 0.2: Open source, zero dependency, graph editor for local AI workflows(floneum.com)
3 points by Evan-Almloff 3y ago|1 comments
20.
by Evan-Almloff 3y ago
Floneum is a graph editor for local AI workflows. The project focuses on ease of use and extensibility. The application is a single installer with no external dependencies. Here are some of the major features in the new release: - Improved
21.
by Evan-Almloff 3y ago
There are a bunch of tasks that require some minimal level of language processing/reasoning that people do that are repetitive. I mentioned a few in my previous response: - Cross referencing your Google calendar with any events discuss
22.
by Evan-Almloff 3y ago
Absolutely, I would love to integrate other types of models (mentioned at the end of the anointment post)! Stable diffusion and whisper.cpp could be a good place to start It is a bit different from Flowise because it is focused on end users
23.
by Evan-Almloff 3y ago
1. I would love to support additional model runners including exLlama and API based models like chat GPT. I'm less familiar with how c transformers and GPTQ compare to llama.cpp. GPTQ used to run faster because it supported GPU acceler
24.
by Evan-Almloff 3y ago
Floneum is still early in development, as it becomes more mature I plan to expand the documentation. In the meantime, you can always ask questions on the discord! Getting feedback about what is currently not clear in the documentation is al
25.
by Evan-Almloff 3y ago
Currently, I'm hoping to find more developers who are interested in contributing to the project (specifically building plugins). Once Floneum is more complete, the target users are any non-develper professionals with repetitive tasks.
26.
Show HN: Floneum, a graph editor for local AI workflows(floneum.com)
61 points by Evan-Almloff 3y ago|17 comments