5 ms·

I wonder if the author would use DuckDB WASM now?

by pspeter3 11mo ago

ngc6677 11mo ago
is it doing HTTP range request, to not download an entire db?
mrtimo 11mo ago
I'm using DuckDB WASM on github pages. This will take about 10 seconds to load [1] and shows business trends in my county (Spokane County). This site is built using data-explorer [2] which uses many other open-source projects including malloy and malloy-explorer. One cool thing... if you use the UI to make a query on the data - you can share the URL with someone and they will see the same result / query (it's all embedded in the URL). [1] - https://mrtimo.github.io/spokane-co-biz/#/model/businesses/explorer/businesses?query=run:%20businesses-%3Ebig_dashboard&run=true https://mrtimo.github.io/spokane-co-biz/#/model/businesses/e... [2] - https://github.com/aszenz/data-explorer https://github.com/aszenz/data-explorer
westurner 11mo ago
From "Show HN: TeaTime – distributed book library powered by SQLite, IPFS and GitHub" https://news.ycombinator.com/item?id=42264274 https://news.ycombinator.com/item?id=42264274 : >> phiresky/sql.js-httpvfs: https://github.com/phiresky/sql.js-httpvfs https://github.com/phiresky/sql.js-httpvfs >> mmomtchev/sqlite-wasm-http: https://github.com/mmomtchev/sqlite-wasm-http https://github.com/mmomtchev/sqlite-wasm-http >> This project is inspired from @phiresky/sql.js-httpvfs but uses the new official SQLite WASM distribution duckdb/duckdb-wasm: https://github.com/duckdb/duckdb-wasm https://github.com/duckdb/duckdb-wasm
- westurner 11mo ago
  "PSA: SQLite WAL checksums fail silently and may lose data" so that's probably not how to sync sqlite; https://news.ycombinator.com/item?id=44672902 https://news.ycombinator.com/item?id=44672902 electric-sql/electric: https://github.com/electric-sql/electric https://github.com/electric-sql/electric : > Specifically, Electric is a read-path sync engine for Postgres. It syncs data out of Postgres into ... anything you like. The core sync protocol is based on a low-level HTTP API. This integrates with CDNs for highly-scalable data delivery. electric-sql/pglite: https://github.com/electric-sql/pglite https://github.com/electric-sql/pglite : > Embeddable Postgres with real-time, reactive bindings. "Using Postgres for Everything" https://news.ycombinator.com/item?id=40420474 https://news.ycombinator.com/item?id=40420474

I wonder if the author would use DuckDB WASM now?

is it doing HTTP range request, to not download an entire db?

mrtimo 11mo ago

I'm using DuckDB WASM on github pages. This will take about 10 seconds to load [1] and shows business trends in my county (Spokane County). This site is built using data-explorer [2] which uses many other open-source projects including malloy and malloy-explorer. One cool thing... if you use the UI to make a query on the data - you can share the URL with someone and they will see the same result / query (it's all embedded in the URL). [1] - https://mrtimo.github.io/spokane-co-biz/#/model/businesses/explorer/businesses?query=run:%20businesses-%3Ebig_dashboard&run=true https://mrtimo.github.io/spokane-co-biz/#/model/businesses/e... [2] - https://github.com/aszenz/data-explorer https://github.com/aszenz/data-explorer

westurner 11mo ago

From "Show HN: TeaTime – distributed book library powered by SQLite, IPFS and GitHub" https://news.ycombinator.com/item?id=42264274 https://news.ycombinator.com/item?id=42264274 : >> phiresky/sql.js-httpvfs: https://github.com/phiresky/sql.js-httpvfs https://github.com/phiresky/sql.js-httpvfs >> mmomtchev/sqlite-wasm-http: https://github.com/mmomtchev/sqlite-wasm-http https://github.com/mmomtchev/sqlite-wasm-http >> This project is inspired from @phiresky/sql.js-httpvfs but uses the new official SQLite WASM distribution duckdb/duckdb-wasm: https://github.com/duckdb/duckdb-wasm https://github.com/duckdb/duckdb-wasm

westurner 11mo ago
"PSA: SQLite WAL checksums fail silently and may lose data" so that's probably not how to sync sqlite; https://news.ycombinator.com/item?id=44672902 https://news.ycombinator.com/item?id=44672902 electric-sql/electric: https://github.com/electric-sql/electric https://github.com/electric-sql/electric : > Specifically, Electric is a read-path sync engine for Postgres. It syncs data out of Postgres into ... anything you like. The core sync protocol is based on a low-level HTTP API. This integrates with CDNs for highly-scalable data delivery. electric-sql/pglite: https://github.com/electric-sql/pglite https://github.com/electric-sql/pglite : > Embeddable Postgres with real-time, reactive bindings. "Using Postgres for Everything" https://news.ycombinator.com/item?id=40420474 https://news.ycombinator.com/item?id=40420474