arjenpdevries

6 ms·

1.
by arjenpdevries 4y ago
https://qz.com/1145669/googles-true-origin-partly-lies-in-ci... Enjoy! It's a great story. (Plus: for who might not know, DARPA is US defense research, and heavily influenced by the intelligence services needs. Wh
2.
by arjenpdevries 4y ago
Yes, that is an advantage. You can also integrate search results for which you cannot have the index, like social media APIs, another reason. You could also mix and match search results from various topic-oriented indices. That's a res
3.
by arjenpdevries 4y ago
The project is starting so not all your questions are answerable today, but, we definitly will produce an open web index, already by the end of the first year, with improvements for years two and three. We further deliver components to make
4.
by arjenpdevries 4y ago
This is not a Gaia-X, it is an exploratory project, showing a possible way forward and setting first steps.
5.
by arjenpdevries 4y ago
Google started out of a CIA funded Stanford project.
6.
by arjenpdevries 4y ago
We like Federated search, we like decentralized search, and even P2P search; we are trying to find a good mix, and decided to get started rather than wait! Exciting times.
7.
by arjenpdevries 4y ago
For starters: the objective is to create the index not the engine, that's quite a different ambition. We are very aware of the Quaero/Theseus history :-)
8.
by arjenpdevries 4y ago
That cannot be true, as the project has yet to start. But anyone can start a crawler, so you may have encountered other people's software. We wouldn't be so unknowledgeable to ignore robots.txt ;-)
9.
by arjenpdevries 4y ago
Isn't it lovely?!
10.
by arjenpdevries 4y ago
That's the marketing story. I think it's because they didn't clutter their homepage like AltaVista did.
11.
by arjenpdevries 4y ago
Slovenia, Czech Republic. But yes, I think there was a competing proposal from Italy/Spain. Not enough budget for two projects in this area, unfortunately, as they were good too.
12.
by arjenpdevries 4y ago
We will explore that idea in the project, I also think it may help (but vulnerable for Web index spam by adversary parties).
13.
by arjenpdevries 5y ago
(All the possible extensions you mention would be beneficial for the solution using DUCKDB.)
14.
by arjenpdevries 5y ago
Arrow is meant to share data as-is instead of requiring a copy, and, often, serialization/deserialization. (This requires both ends to be able to handle the Arrow representation.) Eg, it has the potential to speed up query processing i
15.
by arjenpdevries 5y ago
Great exposition of benefits of DuckDB to augment Pandas for data analysis.