scriptsmith

9 ms·

1.
by scriptsmith 2mo ago
It's a reference to this story where an OpenAI model broke out of its sandbox during cyber benchmarking and hacked into HuggingFace, in order to obtain test solutions: https://news.ycombinator.com/item?id=48997548
2.
by scriptsmith 2mo ago
I made these to create styled text art for the MOTD of my university's HPC login node: https://github.com/ScriptSmith/tart https://tart.sh/
3.
by scriptsmith 3mo ago
Is GitHub Copilot the best positioned platform for enterprise? They support Claude, GPT, Gemini, and now even open weight models. Larger orgs are paying at API rates anyway so it costs just as much as anywhere else. They have a pretty good
4.
by scriptsmith 3mo ago
Definitely took longer than I was expecting, then after two weeks I thought we'd never get it.
5.
by scriptsmith 3mo ago
And now is this going to be a one-off, or routine with every new generation of models?
6.
by scriptsmith 4mo ago
It's based on a Gemma 3n model, and yeah it's not the best. But if you have a use case that needs constrained JSON output for example, it's pretty neat. Maybe it would do better with the new Gemma 4 models, which the Chrome d
7.
by scriptsmith 4mo ago
I've got some demos of what the new Prompt API in Chrome that uses a local model can do: https://adsm.dev/posts/prompt-api/#what-could-you-build-with... As OP says, it shines in constrained environments where
8.
by scriptsmith 4mo ago
Chromium mostly does not support this, because it doesn't have the binary blob required to run the inference. However, it does still download the model weights and expose the LanguageModel API, because that part is hooked up. https:&#
9.
by scriptsmith 4mo ago
> My understanding is that you’ll have to explicitly agree to download alternate models in the future, per the specification I don't get that from the spec. Closest thing I could find in the Writing and Assistance APIs spec [1] (whi
10.
by scriptsmith 4mo ago
Depends on where you get it. By default the flags will be enabled, but some packagers may choose to disable them. I haven't seen a major distro release chromium 148 yet. Weirdly though, chromium won't be able to actually use the m
11.
by scriptsmith 4mo ago
I wrote a more detailed blog post here: https://news.ycombinator.com/item?id=48028662
12.
by scriptsmith 4mo ago
Chromium doesn't support this API because it needs a binary blob to run the inference, although in theory it may still be configured to download the weights: https://adsm.dev/posts/prompt-api/#which-browsers-s
13.
by scriptsmith 4mo ago
It can only be called after the user has interacted with the page, but there's no dialogue from the browser https://developer.chrome.com/docs/ai/get-started#user-activa...
14.
by scriptsmith 4mo ago
Author here. After trying out the Prompt API over the last week, I wrote up some details on the chromium internals, how to use the API, and made some toy demos. It's a 4 GB model that can be used to run on-device inference.
15.
by scriptsmith 4mo ago
In my understanding, yes. I wrote a blog post about some of the internals here: https://news.ycombinator.com/item?id=48028662
16.
The Prompt API is now on by default in Chrome(adsm.dev)
4 points by scriptsmith 4mo ago|2 comments
17.
by scriptsmith 4mo ago
Google has been trialling the Prompt API in chrome for the over a year, so before Gemma 4 existed. But they are indicating they'll move to Gemma 4: https://groups.google.com/a/chromium.org/g/blink-dev&#x2
18.
by scriptsmith 4mo ago
It's based on Gemma 3n, and it's not the best. I find it works fine for simple classification, translation, interpretation of images & audio. It can write longer prose, but it's pretty bad. It can also write text in the f
19.
by scriptsmith 4mo ago
Those flags will exist already, but will default to enabled in 148. That other flag is for using a different open-source inference engine to the (from what I can tell) closed-source one that's used by default.
20.
by scriptsmith 5mo ago
If Chrome has the #optimization-guide-on-device-model and #prompt-api-for-gemini-nano flags enabled, either because it's part of some Origin Trial / Early Stable Release or something, then web pages will have access to the new
21.
by scriptsmith 6mo ago
Yes, you could turn it around to say that using Anthropic models in Cursor, Copilot, Junie, etc. is 'subsidising' Claude Code users.
22.
by scriptsmith 6mo ago
The "First-class syntactic selection" reminds me of my most used shortcut(s) in Jetbrains IDEs: the Expand / Shrink Selection. Ctrl + W Ctrl + Shift + W https://www.jetbrains.com/help/idea/w
23.
by scriptsmith 2y ago
Yes, I've used the v3.2 3B-Instruct model in a Slack app. Specifically using vLLM, with a template: https://github.com/vllm-project/vllm/blob/main/examples/tool... Works as expected if you prov
24.
by scriptsmith 2y ago
To keep on-top of tabs in Firefox, I use 'Auto Tab Discard' [1] to discard tabs after a certain amount of inactivity. Then when I need to clean up my list of tabs, I click on any discarded tabs I want to keep, and then use my exte
25.
by scriptsmith 2y ago
Someone posted this in the thread, but I also can't log in to verify > Summary > CrowdStrike is aware of reports of crashes on Windows hosts related to the Falcon Sensor. > Details > Symptoms include hosts experiencing a bu
26.
by scriptsmith 2y ago
It's crowdstrike: https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod_e... > 7/18/24 10:20PT - Hello everyone - We have widespread reports of BSODs on windows hosts, occurring on
27.
by scriptsmith 3y ago
Seems like he actually disagrees here: If you train a bigger model on more text, we have a lot of confidence that the next-word prediction task will improve. So algorithmic progress is not necessary, it's a very nice bonus, but we can
28.
by scriptsmith 3y ago
How are people using these local code models? I would much prefer using these in-context in an editor, but most of them seem to be deployed just in an instruction context. There's a lot of value to not having to context switch, or have
29.
by scriptsmith 3y ago
Is there some trick to doing validation of request data using this process? That's a valuable part of using something like tRPC, JSON Schema + type generation, zod, etc.
30.
by scriptsmith 3y ago
Don't forget Right-To-Left languages, that also affects how UI elements are arranged (position within the page) and rendered (input widgets like sliders get reversed).

More ›