ikreymer

6 ms·

1.
by ikreymer 2y ago
Every archiving tool out there makes trade-offs about what is archived and how. No one preserves the raw TLS encrypted H3 traffic because that's not useful. When you browse through an archiving MITM proxy, there are different trade-off
2.
by ikreymer 2y ago
Unfortunately, there is not much we can do about transfer-encoding, but the data is otherwise exactly as is returned from the browser. Browsertrix uses the browser to create web archives, so users get an accurate representation of what they
3.
by ikreymer 2y ago
This isn't really true, our tools do not just modify response data for no reason! Our tools do the best that we can with an old format that is in use by many institutions. The WARC format does not account for H2/H3 data, which is
4.
by ikreymer 3y ago
Memory usage increases for long-running session, see this issue for more details: https://github.com/microsoft/playwright/issues/6319
5.
by ikreymer 3y ago
If you have other extensions, disable all of them before trying to record. Content from other extensions can't be accessed due to recent security changes in Chromium, and can cause that error. We'll add it to the Common Errors Pag
6.
by ikreymer 4y ago
A bit late to this thread, but I think WARC is a reasonable format for raw HTTP traffic. We should definitely have better tools to ensure WARC files produced are valid, and that's one of the things we build at Webrecorder. Unless you&#
7.
Show HN: AWP Express: Instant, distributed browser-based web archiving(express.archiveweb.page)
1 points by ikreymer 5y ago|0 comments
8.
by ikreymer 6y ago
At this point, mostly time constraints maintaining two very different implementations. The archiving is done via the CDP Fetch domain ( https://chromedevtools.github.io/devtools-protocol/tot/Fetch... ), as it requir
9.
by ikreymer 6y ago
ArchiveWeb.page is the latest tool from the Webrecorder project. It works as a Chrome (or Brave, or Edge) browser extension or as a standalone Electron app. There's also an experimental IPFS-sharing feature, which will share whatever w
10.
Show HN: Archive as you browse, store locally and/or share with others via IPFS(archiveweb.page)
71 points by ikreymer 6y ago|9 comments
11.
Show HN: Browse the (old) web with emulated browsers running in your browser(oldweb.today)
5 points by ikreymer 6y ago|2 comments
12.
by ikreymer 6y ago
I'm excited to share the latest update from Webrecorder project, the release of a new OldWeb.today ( https://oldweb.today ), now running emulated browsers using JS/WASM entirely in your browser! This is an update to the
13.
by ikreymer 9y ago
Webrecorder supports remote browsers that allow you to run older browsers pre-configured with Flash, as well as Java applets. http://rhizome.org/editorial/2016/oct/25/rhizome-releases-ma... Example: Reco
14.
by ikreymer 9y ago
Unfortunately, this approach alone will only work for sites that are mostly static, eg. do not use JS to load dynamic content. That is a small (and shrinking) percent of the web. Once JS is involved, all bets are off -- JS will attempt to l
15.
by ikreymer 9y ago
Thanks Jack for mentioning Webrecorder! This is a project I started and it is now part of rhizome.org, a non-profit dedicated to promoting internet-based art and digital culture. I thought I’d add a few notes here, as there’s a few ways you
16.
by ikreymer 11y ago
I don't think JS-based emulators are quite there yet in terms of performance, but I've no doubt that they will be eventually. I think this is the next best option for now.
17.
by ikreymer 11y ago
Yes good point, this warrants some more research. The sudo was useful for install but I should see if it can be removed. Should also explore if there are concrete ways that the host can be attacked from the container, if a user does manage
18.
by ikreymer 11y ago
There are many reasons. From technology standpoint, as the web changes, old technologies may no longer work in new browsers. One case in point: Java applets. A few of the old browsers on oldweb support Java applets, which most likely won&#x
19.
by ikreymer 11y ago
oldweb.today connects to various web archives and allows users to browse old websites in old browsers, each running in a Docker container. Emulators such as Basilisk, Sheepshaver and Wine are used to run old MacOS and Windows browsers, alon
20.
Browse the archived web the old way: 13 emulated browsers in your browser(oldweb.today)
91 points by ikreymer 11y ago|13 comments