boywitharupee

5 ms·

1.
by boywitharupee 1mo ago
is this mainly about making host binaries self-contained for heterogenous workloads? also, seems like this is mostly targeted towards HPC audience?
2.
by boywitharupee 2mo ago
is it this? https://github.com/janestreet/incremental
3.
by boywitharupee 4mo ago
You can denoise it: https://github.com/google/security-research/security/advisor...
4.
by boywitharupee 4mo ago
> has been looping indefinitely this can mean WebContent process is crashing
5.
by boywitharupee 5mo ago
the timer and urgency of this reminds me of the movie Armageddon where they had limited time to form a crew for a space mission.
6.
by boywitharupee 7mo ago
they have a watchdog loop, it runs periodically
7.
by boywitharupee 9mo ago
shouldn't the title be "CUDA Tile IR Open Sourced"?
8.
by boywitharupee 1y ago
is there a document or reference implementation that describes the full algorithm? tiling, sorting, merging, and strip conversion.
9.
by boywitharupee 2y ago
> In C++, it's an rvalue reference , which can be effectively thought of as an lvalue hmm...this doesn't sound quite right? the comma operator's result in C++ is not an rvalue reference - it takes on exactly the value cate
10.
by boywitharupee 2y ago
so, these are hand optimized primitives for specific model of nvidia gpus? do you still have to make launch/scheduling decisions to maximize occupancy? how does this approach scale to other target devices with specialized instruction s
11.
by boywitharupee 2y ago
can someone explain how is profiling tools like this written for GPU applications? wouldn't you need access to internal runtime api? for ex. Apple wraps Metal buffers as "Debug" buffers to record allocations/deallocation
12.
by boywitharupee 2y ago
what kind of model architecture was used for this? is it safe to assume they used a transformer model or a variant of it?
13.
by boywitharupee 2y ago
what's the purpose of this? is it one of those 'fun' problems to solve?
14.
by boywitharupee 2y ago
how different is this compared to Facebook's open-source tool Faiss[1]? [1] https://github.com/facebookresearch/faiss/
15.
by boywitharupee 2y ago
In a similar fashion, you'll see that JAX has frontend code being open-sourced, while device-related code is distributed as binaries. For example, if you're on Google's TPU, you'll see libtpu.so , and on macOS, you&#x27
16.
by boywitharupee 2y ago
or have the right entitlements? https://developer.apple.com/documentation/bundleresources/en...
17.
by boywitharupee 2y ago
> At runtime, C&P generates executable code by copying the object code and patching the holes with runtime known values. how would this work on OSs under hardened runtime rules?
18.
by boywitharupee 2y ago
will you also provide compute resources?
19.
by boywitharupee 2y ago
how would you compare this to the polytope model? https://en.wikipedia.org/wiki/Polytope_model
20.
by boywitharupee 2y ago
and is Griffin a state space model?
21.
by boywitharupee 2y ago
i wonder if we can train a foundational model on this data which will eventually allow to semantically search the codebase?
22.
by boywitharupee 2y ago
what's the memory and compute requirements for this?
23.
by boywitharupee 2y ago
but which model to tokenize with? is there a leaderboard for models that are good for RAG?
24.
by boywitharupee 3y ago
is this known as a procedural generation?
25.
by boywitharupee 3y ago
care to explain why attention has precision issues with fp8?
26.
by boywitharupee 3y ago
the title seems like a misnomer. shouldn't this be "python 3.13 gets a new jit compiler" because python already has a jit.
27.
by boywitharupee 3y ago
JAX is a wrapper on top of XLA. Instead of writing pure python, you're writing JAX abstractions. for ex, a simple loop in JAX: def solve(i, v): return i+v x = jax.lax.fori_loop(0, 5, solve, 10)
28.
by boywitharupee 3y ago
> what the Komoglorov complexity of "NSFW GLSL Content" is can you explain what you mean by above?
29.
by boywitharupee 3y ago
currently, on apple silicon "GPU" <> "Metal" are synonymous. yes, there are other apis (opengl,opencl) to access the gpu but they're all deprecated. technically, yes, this is using Metal.
30.
by boywitharupee 3y ago
in tinygrad, the llama2 model with Metal runtime produces 1k kernels. this means we have to compile them all, leading to both startup and runtime costs from repeated compilations and buffer bindings. someone suggested using one megakernel t

More ›