juntao

7 ms·

1.
A WASM runtime for running LLMs locally(github.com)
1 points by juntao 3y ago|0 comments
2.
by juntao 3y ago
Maybe you can try https://flows.network/ , which supports environment variables when creating an app. You can also manage the environment variables later with their UI. Click on https://flows.network/flow&#x2
3.
by juntao 3y ago
I'm wondering what will happen if we let ChatGPT review these PRs created by ChatGPT. Yes, We made a small tool to help developer review their PR. Seems a great supplement for Sweep AI. Build your own PR review bot in 3 minutes here:
4.
by juntao 3y ago
Actually, That's why I got your post so quickly.
5.
by juntao 3y ago
We made a tool to Hacker News Posts with ChatGPT. You can customize which topic you're concerned about, then ask ChatGPT to give you a TLDR of the posts. Welcome to give it a try! Discord version: https://github.com/fl
6.
by juntao 4y ago
Github as the conversational UI.
7.
by juntao 4y ago
Hmm, we allow the CLI to execute AOT code sections embedded in WASM files as a convenience feature -- you can do AOT compilation and then execute it on your CLI. For server side deployment, you should always do the AOT compilation on the se
8.
by juntao 4y ago
I can think of a few: * Lightweight (no GC, under 2MB) * Designed to be a secure sandbox (not just a language runtime) * Modular (add host functions as needed — eg support for Tensorflow) * Multiple languages (esp compiled languages like Ru
9.
by juntao 4y ago
Personally, I believe v8 is and always will be primarily focused on the browser use case. It’s support for wasi, container tooling will always take a back seat compared with priorities in the browser. Today, there are a large set of Rust a
10.
by juntao 4y ago
We are hoping to get WasmEdge running on as many IoT devices as possible … We would love to see more containerization on the edge: https://www.cncf.io/blog/2021/11/11/containerization-on-the-...
11.
by juntao 4y ago
Disclaimer: I am a maintainer at WasmEdge. One of the benefits of running JS in Wasm (specifically the QuickJS approach) is that you can create JS APIs in Rust. That allows you to move a lot of compute intensive operations into Rust while s
12.
by juntao 4y ago
Will improve! Thanks! One of the challenges is that Wasm supports multiple languages. So, we will have to decide to start from a Rust app or a JS app or something else. Would love your suggestions.
13.
by juntao 4y ago
Disclaimer: I am a maintainer of WasmEdge. WASI-NN allows Wasm to be a wrapper of native tensor frameworks — very much the same way Python is a wrapper for Tensorflow and PyTorch. The benefit of using Wasm as a wrapper is its high performan
14.
by juntao 4y ago
I am a maintainer of the WasmEdge project. Yes, it is written in C++ for two reasons: 1 C++ apps can run a lot of edge hardware devices and OSes. We are running on RTOS like seL4 and CPUs like RISC-V. 2 There are already two leading Wasm ru
15.
by juntao 4y ago
They are all outside of traditional mega data centers. :)
16.
by juntao 4y ago
I am a maintainer at WasmEdge. :) The name “edge” signifies that it is lightweight. We think it is a lightweight and secure alternative to Linux containers. The application use cases include containerization on edge devices, serverless func
17.
by juntao 4y ago
Running PHP in WebAssembly is so cool!
18.
by juntao 5y ago
Great articles! > the unification of Docker and Wasm containers will happen at the orchestration layer. In fact, it happens now. The integration with WasmEdge and K8s toolings has been done. Developers could use crun, CRI-O, containerd,
19.
by juntao 5y ago
he WasmEdge Runtime (formerly SSVM) is a lightweight and high-performance WebAssembly (WASM) VM optimized for edge computing. It is widely used in scenarios ranging from cloud serverless functions, SaaS, blockchain smart contracts, IoT, to
20.
High Performance and Safe AI as a Service in Node.js with Rust and WebAssembly(secondstate.io)
1 points by juntao 6y ago|0 comments
21.
by juntao 6y ago
Yes. Because WebAssembly provides a higher level of abstraction (safety, isolation, portability, manageability etc — you know, the “enterprise” stuff) over native code. See here: https://www.secondstate.io/articles/why-
22.
The First Wave of GPT-3 Enabled Applications Offer a Preview of Our AI Future(infoq.com)
3 points by juntao 6y ago|0 comments
23.
Deno Apps with WebAssembly, Rust, and WASI(secondstate.io)
6 points by juntao 6y ago|0 comments
24.
Raspberry Pi on Steroids with Rust and WebAssembly(secondstate.io)
2 points by juntao 6y ago|0 comments
25.
by juntao 6y ago
We took that experts at IBM and MIT would be honest about their performance findings. :) But, it appears that actual performance numbers are of great interest to the community. We will create repeatable benchmarks and open source them. Stay
26.
by juntao 6y ago
Thanks, updated.
27.
by juntao 6y ago
The speed differences between Python, JS, and C++/Rust are well documented. https://www.secondstate.io/articles/performance-rust-wasm/ But, of course, they are not universal and tend to have a large effect
28.
by juntao 6y ago
This is the same reason why people write Java but not C++ Apache extensions on the server side. It is safer and more portable to run bytecode inside containers.
29.
Show HN: SSVM – Speed up your Node.js apps with Rust and WebAssembly
5 points by juntao 6y ago|0 comments
30.
Show HN: SSVM – Speed up your Node.js apps with Rust and WebAssembly(secondstate.io)
7 points by juntao 6y ago|9 comments

More ›