Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
zylepe
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
by
zylepe
3mo ago
Vibes are all that matter. As soon as you start measuring it, that measurement becomes a target and vendors start optimizing for it at expense of the general usefulness of the model. We’ve seen plenty of models with great benchmark scores f
2.
▲
by
zylepe
7mo ago
Cool! I definitely felt the pain of current options when I added parquet support to Planetiler to process overture data. I ended up using parquet-floor to trim the dependencies but it’s a bit of a hacky approach. If there’s a way to use the
3.
▲
by
zylepe
8mo ago
Planetiler currently supports generating MLT by adding —-tile-format=mlt cli argument. It’s only on latest main right now but I should be able to get a release out in the next few days. In my testing I’ve seen ~10% reduction in overall Open
4.
▲
by
zylepe
8mo ago
Pole of Inaccessibility is also a useful technique for placing the label for a polygon at a visually pleasing location on a map. @mourner came up with a more efficient algorithm for computing the point https://blog.mapbox.com
5.
▲
by
zylepe
11mo ago
I haven’t used markdown in javadoc yet but this seems like at least 3/10? I often want to put paragraphs or bulleted lists in javadoc and find myself wanting to use markdown syntax for readability in the code but need to switch to less
6.
▲
by
zylepe
1y ago
A friend of mine is on a 25 year running every day streak. He flew to Australia and landed 2 days after taking off and said that day “never existed for him” ¯\_(ツ)_/¯
7.
▲
by
zylepe
3y ago
I’ve stopped at that Lee McDonald’s and remember thinking the price seemed kind of high. Little did I know it was the most expensive in the country. Even the eastbound one across I-90 is $1.40 cheaper!
8.
▲
by
zylepe
3y ago
I’m looking forward to be able to memory-map an entire large file without having to split it up into 2gb segments, and to be able to reliably unmap it when done. So many hacks to work around this lack of functionality today…
9.
▲
by
zylepe
3y ago
I came up with an approach for placing labels where each gets a min zoom to show up at such that there are no collisions and always appears beyond that. Personally I like the feel of it a lot better, but the downside is that at a given zoom
10.
▲
by
zylepe
3y ago
The protomaps basemap is also built on planetiler: https://github.com/protomaps/basemaps - and Brandon is one of the main contributors a to planetiler!
11.
▲
Explorable Overture Map Tiles
(msbarry.github.io)
2 points
by
zylepe
3y ago
|
0 comments
12.
▲
by
zylepe
3y ago
Exactly, this use case is write-once then read-only after that. Random updates to the sqlite file after that would need more “normal” settings, but they wouldn’t also need as much throughput.
13.
▲
by
zylepe
3y ago
I spent a while optimizing sqlite inserts for planetiler, this is what I came up with: https://github.com/onthegomap/planetiler/blob/db0ab02263baaa... It batches inserts into bulk statements and is able to do
14.
▲
by
zylepe
4y ago
I built planetiler ( https://github.com/onthegomap/planetiler ) for this purpose. The output up to z14 is ~80gb and depending on how big of a machine you have it takes from 30 minutes up to a few hours - no DB required,
15.
▲
by
zylepe
4y ago
You may have chosen Valhalla for other reasons, but FWIW I’ve found Graphhopper can handle 1-2 orders of magnitude more qps than Valhalla on the same hardware.
16.
▲
by
zylepe
4y ago
We’ve been experimenting with R2 for serving tiles from an 80gb pmtiles archive, unfortunately the latency on up to 3 byte range requests from a worker is 5-10 seconds so it’s not practical for real usage yet. Can we expect that to improve
17.
▲
by
zylepe
4y ago
You can track progress for planetiler producing pmtiles output here: https://github.com/onthegomap/planetiler/issues/98 . Another bonus of writing pmtiles directly is that it will cut the time to generate vect
18.
▲
by
zylepe
4y ago
Another option if you want to offload the tiles from embedded in your docker image to static file hosting would be to convert the mbtiles output to pmtiles [1]. Then just upload the pmtiles file to s3 or similar and use the maplibre plug-in
19.
▲
by
zylepe
4y ago
Nice! I was going to point out the project I’ve been working on [1] to reduce the cost but I see you’ve already found it :-) Feel free to reach out it you run into any issues! [1] https://github.com/onthegomap/planetile
20.
▲
by
zylepe
4y ago
I recently found this approach: https://github.com/onthegomap/planetiler/blob/main/planetile... but I’m hoping this api will eventually let you do that without an external dependency or writing/comp
21.
▲
by
zylepe
5y ago
I have a google sheet where I keep track of each fund I’ve bought and sold. From there I added a column with gain/loss for each tax lot with remaining shares, and a script that runs once a day to email me if there’s an opportunity for
22.
▲
by
zylepe
5y ago
I make a photo book once a year with the best photos from the year. I use Amazon photos, google photos, etc but the hard copy book is the only one I’d expect to still be around in 100 years. For an offsite backup, I should start printing 2
23.
▲
by
zylepe
5y ago
Yep, that first one will do it! And you probably want to rip out the polygon merging code and minimum zoom on the attrs. You can use --only-layers= or --exclude-layers= if you don't want all the others.
24.
▲
by
zylepe
5y ago
The main driver of memory usage (~1.0x the input file size) is storing node locations so we can convert the list of node IDs on each way into lat/lon coordinates. By default nodes are stored in a memory-mapped file so it can run with l
25.
▲
by
zylepe
5y ago
Nothing is foolproof, but for web-based traffic, proper CORS configuration or rejecting traffic based on the referrer (or lack thereof) would go a long way.
26.
▲
by
zylepe
5y ago
Flatmap calls into user-defined profiles in 2 places: first when processing each input element to map it to a vector tile feature, then a second time right before emitting all vector features in a layer. That second call lets you manipulate
27.
▲
by
zylepe
5y ago
I generated the planet a few times in testing: with z13 building merge (extra 14 CPU hours of processing): - $4.68 on Digital Ocean 128GB 16 CPU instance (4 hours @ $1.17/hr) without z13 building merge: - $2.75 on AWS EC2 c5
28.
▲
by
zylepe
5y ago
Thanks! The default "basemap" style is ported from OpenMapTiles v3.12.2.
29.
▲
by
zylepe
5y ago
Thanks! Glad you find it useful!
30.
▲
by
zylepe
5y ago
Thanks! Tilemaker is a great tool and probably the closest alternative (no intermediate db). The most recent benchmarks I saw though were around a day for the planet, so roughly 10x longer than flatmap. If Edit: benchmark link https:/
More ›