jmuncor

7 ms·

1.
Tokentap – Print what your LLM is thinking(github.com)
2 points by jmuncor 2mo ago|1 comments
2.
by jmuncor 2mo ago
Tokentap is a tool that helps you print the whole context window as you interact with an LLM (Claude, Codex, Gemini, etc). So that you can understand exactly what is going on 'under the hood' of your interaction.
3.
Local memory for any LLM agent(github.com)
1 points by jmuncor 7mo ago|1 comments
4.
by jmuncor 7mo ago
This repo is a local database that stores your facts, memories and facts locally so that you centralize everything in your local system. Mumpu - Middleware for Universal Memory Persistence and Understanding
5.
by jmuncor 8mo ago
That was what I wanted to answer.. hehe What edge cases can you think of, and what polish do you think I can add?
6.
by jmuncor 8mo ago
Sometimes simplicity is the best thing to have.
7.
by jmuncor 8mo ago
Not only trust, but how you later optimize what is in the context to cater how you use llms... There is a whole world to be explored inside that context window.
8.
by jmuncor 8mo ago
Thank you, what I was thinking was more along the lines of optimizing how you use your context window. So that the LLM can actually access what it needs to, like a incredibly powerful compact that runs in the background with your file syste
9.
by jmuncor 8mo ago
I love this idea... Going to look into it, thank you!
10.
by jmuncor 8mo ago
Yes, I think you can actually later store this in a database and start querying and optimizing what is happening there. Even you can start using these files or a destilation of these as long term memory.
11.
by jmuncor 8mo ago
That is exactly the idea, later we can actually tap into the middle and optimize how the context is actually being used. Feels like the current anthropic tools like compact don't do a great job at it.
12.
by jmuncor 8mo ago
You can always try right?
13.
by jmuncor 8mo ago
Yes... Got it patched up and fixed some security issues it had. Let me know what you think of the new version.
14.
by jmuncor 8mo ago
Ohh my, no offense taken... The next time I will be a lot more careful with the stuff that I put out there. Learning and getting the hang of it, would love if you either comment on the code or here any other things you think could be improv
15.
by jmuncor 8mo ago
I love the real feedback tbh, I am still learning, and want to learn as much as possible. Would love if you can review it and tell me bluntly either in the repo or here the things that should be improved. I would love to learn more from you
16.
by jmuncor 8mo ago
Now you can add on top of it :D and we can all create something great :D
17.
by jmuncor 8mo ago
Just fixed it and implemented a simple http relay, eliminating the mitmproxy and the ssl_insecure=true. The new implementation uses TLS verification, doing last tests and merging it... After the merge can you check it out and tell me if I e
18.
by jmuncor 8mo ago
The idea is to simplify and store it... Thinking of changing it to http relay, what do you think?
19.
by jmuncor 8mo ago
Something like sherlock start --otel-endpoint?
20.
by jmuncor 8mo ago
Could add support if you need it! Just let me know :D
21.
by jmuncor 8mo ago
This works with claude code and codex... So you can use with any of those, you dont need a local llm running... :)
22.
by jmuncor 8mo ago
Got it on the feature branch http-relay, let me know what you think!
23.
by jmuncor 8mo ago
That is what you would call vibe-ception... Hahahahah correcting it now! hahahahahahahaha!!
24.
by jmuncor 8mo ago
Working on this feature right now!! Thank you for the suggestion, will start the branch for it... Whent think of improving the context window usage, now that with an http relay we can start thinking of intercepting the context window, anyth
25.
by jmuncor 8mo ago
What would you think of simply using an http relay for all providers? Would that make you feel better secutity wise? also could extend the tool to change the context you are sending and make it more granular to what you want/need...
26.
by jmuncor 8mo ago
Agee! This was a fun project that I build because it is so hard to understand what "really" is in you context window... What do you mean by plugin/add-on? Add-on to what? Thinking of what to add to it next... Maybe security w
27.
by jmuncor 8mo ago
I didn't understand the quesion I am sorry.
28.
by jmuncor 8mo ago
Love you like it!! Let me know any ideas to improve it... I was thining in the direction of a file system and protocol for the md files, or dynamic context building. But would love to hear what you think.
29.
by jmuncor 8mo ago
Have you tried this with Gemini? or Codex?
30.
by jmuncor 8mo ago
I agree, I remember when the feed forward NN were the shit! And now the LLMs are owning, I think this adoption pattern will start pulling a lot of innovations on other computer science fields. Networking, for example. But the ability to hav

More ›