8 ms·
Show HN: Arxiv.org on IPFS
- woile 5y agoWow looks super nice, feels so easy to navigate and read, I was thinking it would be nice to have a RSS feed for some topics to read as news. Great work!
- hugoroussel 5y agoBuild this during an hackathon where I felt like that arXiv was in grand need of a small face lift. Currently not all articles are uploaded. The repository is here : http://github.com/hugoroussel/xirva http://github.com/hugoroussel/xirva
- ithinkso 5y agoNot to be confused with viXra, which is a sci-fi alternative to arXiv
- hugoroussel 5y agoI nearly called the project this name without knowing it existed. Thanks for the share.
- kloch 5y agoviXra is full of nonsense but then again so is arXiv (see: 750GeV debacle). viXra desperately needed a voting system and if it did it would likely have been much more useful and become a viable alternative to arXiv. arXiv does not accept papers from authors with no institutional affiliation and viXra was the only (and ugly) alternative. There is an opportunity there to fix both sites.
- detaro 5y agoWhat was the 750GeV debacle? That thing were some people said LHC had found a new particle maybe?
- kloch 5y agoA spurious signal at LHC (that disappeared in later runs) that spurred a cottage industry of arXiv submissions trying to explain it. Authors, mostly grad students, quickly submitted hundreds of low quality articles trying to get in on the "discovery". Later articles would cite over 400 previous articles and it became one giant circle jerk. There were even blog posts complaining about the blatant "ambulance chasing". https://motls.blogspot.com/2016/06/ambulance-chasing-is-justifiable.html https://motls.blogspot.com/2016/06/ambulance-chasing-is-just... http://resonaances.blogspot.com/2016/06/game-of-thrones-750-gev-edition.html http://resonaances.blogspot.com/2016/06/game-of-thrones-750-...
- MayeulC 5y agoDoesn't seem to work (I don't have a local gateway on this machine): https://www.xirva.org/list/eess.IV/2011/2011.00052 https://www.xirva.org/list/eess.IV/2011/2011.00052 Brings me to https://ipfs.io/ipfs/undefined/2011.00052.pdf https://ipfs.io/ipfs/undefined/2011.00052.pdf which says: invalid ipfs path: invalid path "/ipfs/undefined/2011.00052.pdf": invalid CID: expected 1 as the cid version number, got: 31965309853
- hugoroussel 5y agoNot all articles are uploaded yet, it is still WIP.
- fnord77 5y agois search still a WIP?
- hugoroussel 5y agoEverything is still WIP, very difficult to do rich indexing on IPFS files. A new project idea ?
- hevalon 5y agoJust a heads up comment, it seems some of the IPFS links are broken. For example I just visited https://www.xirva.org/categories/cs.AI https://www.xirva.org/categories/cs.AI and all links point to an "undefined" path example https://ipfs.io/ipfs/undefined/2107.00082.pdf https://ipfs.io/ipfs/undefined/2107.00082.pdf But overall, great idea!
- hugoroussel 5y agoNot all articles are uploaded yet, it is still WIP.
- hevalon 5y agothat's fine. Maybe then for a better user experience have grey-out or removed the IPFS download button for the articles that haven't been uploaded yet.
- meroje 5y agolinks ? everything is a fake js button
- T-A 5y agoFrom the repo [1]: "research publishing platform that is community based, transparent and censorship resistant" (my emphasis) "Community members moderate the platform and can increase or decrease the visibility of the uploaded files" (again, my emphasis) [1] https://github.com/hugoroussel/xirva https://github.com/hugoroussel/xirva
- prvc 5y ago>censorship resistant My emphasis.
- Jhsto 5y agoHow does the NFT thing work? I do not have Polygon tokens but I wonder what have you envisioned as the functionality of this to be?
- hugoroussel 5y agoSince it was for a ETHGlobal hackathon I thought it would be fun to experiment with the feature where we mint an NFT where the metadata points to the IPFS link. You could then do whatever you do with an NFT.
- Jhsto 5y agoI wonder how much information do you get from arxiv regarding the dependency graph via citations. Could there be a way that I, as I upload my own manuscript, to tip the authors of the people I citated and conversely someday have the possibility of also generating revenue personally as such? It would be much nicer, I think, if the fees that are currently paid to journals to instead go to the authors that also contributed to my work.
- hugoroussel 5y agoThere are for sure interesting ideas related to new forms of scientific funding. The issue I have and why the project is currently on standby is how to combat spam/hoax articles
- flexd 5y agoHmm, my Firefox here on Ubuntu does not trust that CA for some reason. And clicking "Accept the risk and continue" seems to just land me back at the "Warning: Potential Security Risk Ahead" page.
- hugoroussel 5y agoI think only www.xirva.org has valid certificate, maybe Firefox strips the www for some reason.
- onhn 5y ago"You can upload your research and publish it on the open web. Members of the community will be able to vote on your research to raise its visibility." Oh dear.
- f0e4c2f7 5y agoA perfect system? No, but think about how people must have felt about Wikipedia on launch. Love this idea.
- NmAmDa 5y agoActually I don't think science has democratic nature. Yes we do somehow do that as a theory would still need to be accepted widely. But in reality one person can have the correct idea while all others disagree. Still this person is doing it right.
- lmohseni 5y agoI believe science is a democratic process. If someone has the correct idea but communicates it poorly, so poorly that others in the field disagree, then this person is doing it wrong. (Thinking specifically of https://en.m.wikipedia.org/wiki/Shinichi_Mochizuki https://en.m.wikipedia.org/wiki/Shinichi_Mochizuki )
- hugoroussel 5y agoAll and all it is a non trivial problem. You have at the very least have to attach some kind of form of reputation system into the verification process. Even with that you will still have the "misunderstood genius" issue, or the "excellent reputation professor" that everyone trust without (enough) verification.
- elcritch 5y agoBut at least there’s be a system for other researchers to record “failed to replicate” that could give a channel to critique reputable professors that’s not controlled by the same professors (as they often can in journals).
- brylie 5y agoI get an error on several articles to the effect of: invalid ipfs path: invalid path "/ipfs/undefined/2107.00648.pdf": invalid CID: expected 1 as the cid version number, got: 31965309853
- sebmellen 5y agoHey Hugo, do you have an email I could reach you at? I've been thinking/working on these problems for 3 years now and would love to find some smart people to partner with to further develop the ideas. I don't have much to show publicly right now, but https://intpub.org/ https://intpub.org/ (soon to be scipub.app) is the start.
- deleted 5y ago[deleted]
- eecc 5y agoAlso keep me in the loop, plz :)
- sebmellen 5y agoFor sure! Will do.
- betwixthewires 5y agoOh wow I'm going to be watching your github repo, what you're doing looks interesting. Do you have any plans to implement some search functionality to help find documents, or is it about permissionless publishing only?
- sebmellen 5y agoGreat question! Search is (I believe) a second-order problem. Once permissionless publishing is solved, extensions can be built onto the core protocol. In my opinion, indexing and ranking services work much better as ancillary services. The bundling of indexing and ranking with core protocol features is one of my main contentions with the Coinbase-backed "Research Hub" project/company (https://researchhub.org https://researchhub.org). If you think about it, journals are also important services Also, git repo link needs to be updated, and there's nothing there right now really, but https://github.com/scipubapp https://github.com/scipubapp is the right link!
- sebmellen 5y ago
- aerique 5y agoCool. Now the same for Sci-Hub?
- leavenotracks 5y agoSearch bar doesn't seem to be working...
- hugoroussel 5y agoyes
- eecc 5y agoAh cool… I also took a stab at something similar several years ago: https://github.com/ecausarano/heron https://github.com/ecausarano/heron Also at the time I was considering IPFS. But I guess the real trick is implementing a WOT to implement peer review and filter out the inevitable junk that will be published
- hugoroussel 5y agoExactly the problem that I have. Many edge cases too.
- kloch 5y agoWhat do you mean by junk? Spam and Abuse, or scientific papers that the reviewer simply doesn't like?
- eecc 5y agoWell, as anyone can and will publish, it will be stuffed with junk, porn, trash of all sorts, so my plan was to implement a filter to ignore any data published outside of one’s WOT. Furthermore, a user searching for “reviewed” data and papers would normally filter for items with enough “endorsement” metadata items signed by known WOT actors. I haven’t figured a mechanism to prevent “review rings”, although being totally transparent it should be easy to spot them.
- westurner 5y ago"Help compare Comment and Annotation services: moderation, spam, notifications, configurability" executablebooks/meta#102 https://github.com/executablebooks/meta/discussions/102 https://github.com/executablebooks/meta/discussions/102 : > jupyter-comment supports a number of commenting services [...]. In helping users decide which commenting and annotation services to include on their pages and commit to maintaining, could we discuss criteria for assessment and current features of services? > Possible features for comparison: > * Content author can delete / hide > * Content author can report / block > * Comments / annotations are screened by spam-fighting service > * Content / author can label as e.g. toxic > * Content author receives notification of new comments > * Content author can require approval before user-contributed content is publicly-visible > * Content author may allow comments for a limited amount of time (probably more relevant to BlogPostings) > * Content author may simultaneously denounce censorship in all it's forms while allowing previously-published works to languish #ForScience
- T3RMINATED 5y agoipfs resolve -r /ipfs/bafybeiamnft57u4lniylffuafzxouf4ocaw5uylahfqoawj6rjnvwthuuu/list/cs.CV/2111/: no link named "list" under bafybeiamnft57u4lniylffuafzxouf4ocaw5uylahfqoawj6rjnvwthuuu
- stevejpurves 5y agodoes the upload here also submit to arxiv, or will uploading to xivra mean they diverge?
- hugoroussel 5y agoIt will diverge.
- imback 5y agoSlightly OT, but how is IPFS these days? Every time I've tried using it the past few years it seemed very WIP. Cool sounding protocol though.
- jstanley 5y agoI got turned off it because things that I'd pinned, and knew I'd pinned, would eventually become mysteriously inaccessible unless accessed through the node that I pinned it on, and I couldn't work out why. It's a great idea, but I found it too flakey to satisfy me.
- Taek 5y agoIt's still very slow - retrieval times >30s for files that aren't cached on cloudflare or ipfs.io. Also, those two providers each have multiple periods of downtime every year. If the files are cached and the services are up, it's plenty fast for static data but dynamic data (IPNS) is still very slow. We've built a competitor called Skynet that is much faster (less than 200ms for files that aren't in the cache) and scales better. It's currently hosting tens of millions of files across 200+ TB of data. We really like the vision that IPFS had and we think decentralized data is the future of the Internet. We're proud to have put in the legwork to make it practical. https://docs.siasky.net/ https://docs.siasky.net/
- menmob 5y agoAre you able to “pin” files yourself like IPFS? Or are you required to pay hosts to store it?
- Taek 5y agoYou can always run a host yourself and pin it to your own host. The main reason we chose a host-based architecture instead of a pin based architecture is that we saw on IPFS that having people pin their own data resulted in really poor uptimes, a lot of file rot, and it also substantially reduced scalability and increased fetch times. And after all of those tradeoffs, the vast majority of accessible content on IPFS is hosted via a pinning service anyway.
- enderm 5y agoWhat if every paper was on IPFS? Whenever I try to read an obscure paper published before 1990, the paper is usually behind a paywall.