7 ms·
To create private shareable links, store the private part in the hash of the URL. The hash is not transmitted in DNS queries or HTTP requests. Ex. When links.c
by r2b2 3y ago
To create private shareable links, store the private part in the hash of the URL. The hash is not transmitted in DNS queries or HTTP requests.
Ex. When links.com?token=<secret> is visited, that link will be transmitted and potentially saved (search parameters included) by intermediaries like Cloud Flare.
Ex. When links.com#<secret> is visited, the hash portion will not leave the browser.
Note: It's often nice to work with data in the hash portion by encoding it as a URL Safe Base64 string. (aka. JS Object ↔ JSON String ↔ URL Safe Base 64 String).
- loginatnine 3y agoIt's called a fragment FYI!
- shiomiru 3y agoHowever, window.location calls it "hash". (Also, the query string is "search". I wonder why Netscape named them this way...)
- loginatnine 3y agoInteresting, thanks for the additional info.
- SilasX 3y agoYeah I was confused by it being referred to as the hash. https://en.wikipedia.org/wiki/URI_fragment?useskin=vector https://en.wikipedia.org/wiki/URI_fragment?useskin=vector
- eterm 3y agoIf it doesn't leave the browser, how would the server know to serve the private content?
- jadengeller 3y agoClient web app makes POST request. It leaves browser, but not in URL
- Gigachad 3y agoThat only works if you can run JavaScript. If you want to download a file with curl for example it fails.
- klabb3 3y agoThanks, finally some thoughts about how to solve the issue. In particular, email based login/account reset is the main important use case I can think of. Do bots that follow links in emails (for whatever reason) execute JS? Is there a risk they activate the thing with a JS induced POST?
- 369548684892826 3y agoYes, I've seen this bot JS problem, it does happen.
- r2b2 3y agoTo somewhat mitigate the link-loading bot issue, the link can land on a "confirm sign in" page with a button the user must click to trigger the POST request that completes authentication. Another way to mitigate this issue is to store a secret in the browser that initiated the link-request (Ex. local storage). However, this can easily break in situations like private mode, where a new tab/window is opened without access to the same session storage. An alternative to the in-browser-secret, is doing a browser fingerprint match. If the browser that opens the link doesn't match the fingerprint of the browser that requested the link, then fail authentication. This also has pitfalls. Unfortunately, if your threat model requires blocking bots that click too, your likely stuck adding some semblance of a second factor (pin/password, bio metric, hardware key, etc.). In any case, when using link-only authentication, best to at least put sensitive user operations (payments, PII, etc.) behind a second factor at the time of operation.
- klabb3 3y ago> a button the user must click Makes sense. No action until the user clicks something on the page. One extra step but better than having “helpful bots” wreak havoc. > to store a secret in the browser […] is doing a browser fingerprint match I get the idea but I really dislike this. Assuming the user will use the same device or browser is an anti-pattern that causes problems with people especially while crossing the mobile-desktop boundary. Generally any web functionality shouldn’t be browser dependent. Especially hidden state like that..
- andix 3y agoIs there a feature of DNS I'm unaware of, that queries more than just the domain part? https://example.com?token=<secret> https://example.com?token=<secret> should only lead to a DNS query with "example.com".
- erikerikson 3y agoThe problem isn't DNS in GP. DNS will happily supply the IP address for a CDN. The HTTP[S] request will thereafter be sent by the caller to the CDN (in the case of CloudFlare, Akamai, etc.) where it will be handled and potentially logged before the result is retrieved from the cache or the configured origin (i.e. backing server).
- andix 3y agoThis sounds like a big security flaw in the system that uses access links. Secrets should not be logged (in most cases). When opening a Dropbox/GoogleDocs/OneDrive link, I expect the application not to route them through potentially unsafe CDNs.
- r2b2 3y agoCorrect, DNS only queries the hostname portion of the URL. Maybe my attempt to be thorough – by making note of DNS along side HTTP since it's part of the browser ↔ network ↔ server request diagram – was too thorough.
- jmholla 3y ago> Ex. When links.com?token=<secret> is visited, that link will be transmitted and potentially saved (search parameters included) by intermediaries like Cloud Flare. Note: When over HTTPS, the parameter string (and path) is encrypted so the intermediaries in question need to be able to decrypt your traffic to read that secret. Everything else is right. Just wanted to provide some nuance.
- r2b2 3y agoGood to point out. This distinction is especially important to keep in mind when thinking about when and/or who terminates TLS/SSL for your service, and any relevant threat models the service might have for the portion of the HTTP request after terminattion.
- mschuster91 3y agoCloudflare, Akamai, AWS Cloudfront are all legitimate intermediaries.
- anonymouscaller 3y agoYes, see "Cloudbleed"
- nightpool 3y agoThe secret is still stored in the browser's history DB in this case, which may be unencrypted (I believe it is for Chrome on Windows last I checked). The cookie DB on the other hand I think is always encrypted using the OS's TPM so it's harder for malicious programs to crack
- r2b2 3y agoYes, adding max-use counts and expiration dates to links can mitigate against some browser-history snooping. However, if your browser history is compromised you probably have an even bigger problem...
- phyzome 3y agoHuge qualifier: Even otherwise benign Javascript running on that page can pass the fragment anywhere on the internet. Putting stuff in the fragment helps, but it's not perfect. And I don't just mean this in an ideal sense -- I've actually seen private tokens leak from the fragment this way multiple times.
- eadmund 3y agoWhich is yet another reason to disable Javascript by default: it can see everything on the page, and do anything with it, to include sending everything to some random server somewhere. I am not completely opposed to scripting web pages (it’s a useful capability), but the vast majority of web pages are just styled text and images: Javascript adds nothing but vulnerability. It would be awesome if something like HTMX were baked into browsers, and if enabling Javascript were something a user would have to do manually when visiting a page — just like Flash and Java applets back in the day.