wibyweb

14 ms·

1.
by wibyweb 4y ago
Perhaps you can develop such a browser extension. Sounds like a very good idea actually.
2.
by wibyweb 4y ago
Not sure how yacy works exactly except that its some sort of grand decentralized search engine project that is somehow all connected together.
3.
by wibyweb 4y ago
Do let me know if you succeed
4.
by wibyweb 4y ago
I wish I knew. They have nothing to gain. Its effectively a DDoS attack.
5.
by wibyweb 4y ago
Thank you, I do hope you get around to building a wiby engine!
6.
by wibyweb 4y ago
You can certainly change the crawler's database connection from "localhost" to an IP address on a different machine, but I am unsure how that works with that type of proxy (I had to look up what a socks5 is). Sounds like it c
7.
by wibyweb 4y ago
Thank you! Makes me happy to see people enjoying it.
8.
by wibyweb 4y ago
A group of people would have to band together to share the same table (windex) with each other. Personally I am interested in seeing people try to cultivate their own niche indexes instead of working towards a common one.
9.
by wibyweb 4y ago
Thank you, my index is puny compared to yours and that is because I only index the page submitted by guests and don't go any further. The index is in the 10's of thousands. The hyperlink crawling feature was added and tested out s
10.
by wibyweb 4y ago
With this code you will start out with a blank index and will have to start making submissions to your search engine to build the index, but you can search the results as soon as the pages get crawled. The video demo provides a practical ex
11.
by wibyweb 4y ago
>how big did the fulltext table became for x entries on wiby.me I want Wiby to be comprised mainly of human submitted pages, so for 99% of the index, only the pages submitted by users are indexed and no further crawling was done. However
12.
Show HN: Wiby is now free software(github.com)
161 points by wibyweb 4y ago|35 comments
13.
by wibyweb 4y ago
Interesting, thanks for that extra info.
14.
by wibyweb 4y ago
In late April up to now, Wiby (a small mostly unheard of search engine) began having the exact same issue. Tens of thousands of the exact same type of "powered by..." requests coming from thousands of IPs. They are using a tool ca