4 ms·

Fast trigram based code search

49 points by cv_h 10mo ago

hanwenn 10mo ago
more background: https://sourcegraph.com/blog/zoekt-creating-internal-tools-at-google https://sourcegraph.com/blog/zoekt-creating-internal-tools-a...
darkamaul 10mo ago
GitHub Code Search has too many quirks compared to the zoekt powered alternatives (cs.android.com, cs.bazel.build) which feel far more intuitive. I wish Microsoft would invest more in improving it - especially since Sourcegraph can't search private repositories, leaving GitHub's tool as the only real option for many codebases.
- Scaevolus 10mo ago
  None of Google's public source search engines (android, chromium, bazel) use Zoekt. They use Google's web indexing technology adapted for trigrams, which was mostly developed to support their massive internal monorepo, but exposed for a few of their major open source projects too. You can index private repos with Sourcegraph, but it's a paid feature ($19/mo/user+).
  - sluongng 10mo ago
    > They use Google's web indexing technology adapted for trigrams, which was mostly developed to support their massive internal monorepo Do you have a source for this? I would love to read more about it. In the doc of the Zoekt repo, it says > What does cs.bazel.build run on? > Currently, it runs on a single Google Cloud VM with 16 vCPUs, 60G RAM and an attached physical SSD. https://github.com/sourcegraph/zoekt/blob/main/doc/faq.md#what-does-csbazelbuild-run-on https://github.com/sourcegraph/zoekt/blob/main/doc/faq.md#wh... so at least they were using Zoekt up until a certain point in the past.
    - Scaevolus 10mo ago
      Oops, I guess that one is small enough to use Zoekt. Note how different the interface is than Android and Chromium's code search.
arccy 10mo ago
There's also https://github.com/google/codesearch https://github.com/google/codesearch for local only search
- nbenitezl 10mo ago
  I use https://codesearch.debian.net/ https://codesearch.debian.net/ a lot, and it's based on that according to https://codesearch.debian.net/about https://codesearch.debian.net/about
- rurban 10mo ago
  But it has a web frontend also. So not only local.
fmajid 10mo ago
Keep in mind Source graph has done an open-source bait-and-switch before: https://news.ycombinator.com/item?id=36584656 https://news.ycombinator.com/item?id=36584656
N_Lens 10mo ago
Excellent tool for larger codebases!

49 points by cv_h 10mo ago

more background: https://sourcegraph.com/blog/zoekt-creating-internal-tools-at-google https://sourcegraph.com/blog/zoekt-creating-internal-tools-a...

darkamaul 10mo ago

GitHub Code Search has too many quirks compared to the zoekt powered alternatives (cs.android.com, cs.bazel.build) which feel far more intuitive. I wish Microsoft would invest more in improving it - especially since Sourcegraph can't search private repositories, leaving GitHub's tool as the only real option for many codebases.

Scaevolus 10mo ago
None of Google's public source search engines (android, chromium, bazel) use Zoekt. They use Google's web indexing technology adapted for trigrams, which was mostly developed to support their massive internal monorepo, but exposed for a few of their major open source projects too. You can index private repos with Sourcegraph, but it's a paid feature ($19/mo/user+).
- sluongng 10mo ago
  > They use Google's web indexing technology adapted for trigrams, which was mostly developed to support their massive internal monorepo Do you have a source for this? I would love to read more about it. In the doc of the Zoekt repo, it says > What does cs.bazel.build run on? > Currently, it runs on a single Google Cloud VM with 16 vCPUs, 60G RAM and an attached physical SSD. https://github.com/sourcegraph/zoekt/blob/main/doc/faq.md#what-does-csbazelbuild-run-on https://github.com/sourcegraph/zoekt/blob/main/doc/faq.md#wh... so at least they were using Zoekt up until a certain point in the past.
  - Scaevolus 10mo ago
    Oops, I guess that one is small enough to use Zoekt. Note how different the interface is than Android and Chromium's code search.

arccy 10mo ago

There's also https://github.com/google/codesearch https://github.com/google/codesearch for local only search

nbenitezl 10mo ago
I use https://codesearch.debian.net/ https://codesearch.debian.net/ a lot, and it's based on that according to https://codesearch.debian.net/about https://codesearch.debian.net/about
rurban 10mo ago
But it has a web frontend also. So not only local.

fmajid 10mo ago

Keep in mind Source graph has done an open-source bait-and-switch before: https://news.ycombinator.com/item?id=36584656 https://news.ycombinator.com/item?id=36584656

N_Lens 10mo ago

Excellent tool for larger codebases!