kolja005

7 ms·

1.
by kolja005 5mo ago
This is an interesting perspective I haven't heard before. Do you have links to anyone who has articulated this further?
2.
by kolja005 5mo ago
Think about what the implication here is for people who answered no to that question. If I were to go up to my boss and say "I'm not interested using AI because I think it's bad for society" I would essentially be saying
3.
by kolja005 6mo ago
I would be inclined to agree with this except that my "most common needs" keeps expanding and increasing in difficulty each year. In 2023 and 2024, most of my needs were asking models simple questions and getting a response. They
4.
by kolja005 7mo ago
I just refactored a bunch of our microservices into a monolith. Fortunately the business justification was pretty straightforward because it was clear to all of us that the service architecture was weighing us down. Since one of microservic
5.
by kolja005 7mo ago
>Since the database is used by everyone, it becomes cared for by no one. Startups don’t have the luxury of a DBA, and everything owned by no one is owned by infrastructure eventually. This post was a great read. Tangent to this, I'v
6.
by kolja005 7mo ago
My company has the github page for it blocked. They block lots of AI-related things but that's the only one I've seen where they straight up blocked viewing the source code for it at work.
7.
by kolja005 8mo ago
Hey pretty cool! I recently added a similar feature to my neovim setup. I can press a keymap and cycle through all of the unstaged git hunks with each shown in a preview window. I can also change the base branch to one that, say, I'm t
8.
by kolja005 10mo ago
People like to make fun of these models for sounding like a broken record, being over complementary, etc, but I'm actually starting to think that models having a very recognizable style is a good thing because it makes identifying AI-g
9.
by kolja005 11mo ago
What are folks doing who were just using it for CI/test/dev environments? Just build the image yourself? Use Garage as some have suggested? I'm curious what people see as the pros and cons.
10.
by kolja005 1y ago
This is pretty neat. Similarly, I feel like we are really close to smartwatches being able to replace smartphones for all essential tasks. I try to rely on my apple watch with cellular as much as I can and leave my phone at home. I can&#x27
11.
by kolja005 1y ago
Funny to see this today. I'm a rank and file dev at a non-big tech company and I got a call from a Windsurf sales rep this week who I had connected with on LinkedIn the day before (I never gave them my number). They told me my company
12.
by kolja005 2y ago
As it pertains to Python in particular I think OOP is great for libraries but of limited usefulness at the application layer. Things like pytorch's nn.module IMO is a great abstraction, but every time I've tried to map some concre
13.
by kolja005 2y ago
Do we work at the same company? You put it much better than I could have. Do you know if polars at all solves the problem of having opaque, mutable objects everywhere? I feel like there's a good market for having a dataframe library th
14.
by kolja005 2y ago
I recently watched a talk by the author of uv that was surprisingly fascinating [1]. He goes into a few of the more notable hacks that they had to come up with to make it as fast as it is. The most interesting thing for me was that package
15.
by kolja005 2y ago
Unrelated but does anyone have any recommendations for good resources on learning how to write tests/testable software?
16.
by kolja005 2y ago
Does anyone have a good heuristic for when a dataframe library is a good tool choice? I work on a team that has a lot of data scientists and a few engineers (including myself) and I often see the data scientists using dataframes when simple
17.
by kolja005 2y ago
Related: I found out about a vim/neovim plugin called Molten[1] that tries to be a replacement for Jupyter Notebooks in the terminal. It was a little rough around the edges ~5 months ago when I tried it, but looking at the repo it seem
18.
by kolja005 2y ago
Is there a lot of innovation happening in this space for military applications? I ask this as someone totally unfamiliar with the technology in general. It seems like it could greatly benefit pilots, people on the battlefield, and anyone el
19.
by kolja005 2y ago
I'm curious in what sense you find Python difficult to deploy? My company has tons of Python APIs internally and we never have much trouble with them. They are all pretty lightly used services so it it something about doing it on a lar
20.
by kolja005 2y ago
You might find it interesting to know that for track cycling the penalty due to lower oxygen uptake is less than the advantage due to less air resistance. In other words track cyclists, at least in some of the longer disciplines, will go fa
21.
by kolja005 2y ago
Uber has a phone number that you can call to hail a ride. https://techcrunch.com/2023/05/17/you-can-now-hail-an-uber-b...
22.
by kolja005 2y ago
I use an app called Jomo to block YouTube, as well as about 10 other distracting applications. It runs on every device I have and makes it very challenging to use the app when I feel the urge to. For a long time I convinced myself that I ne
23.
by kolja005 3y ago
There needs to be an updated CLIP-like model in the open-source community. The model is almost three years old now and is still the backbone of a lot of multimodal models. It's not a sexy problem to take on since it isn't especial
24.
by kolja005 3y ago
Been following Jon Barron et al’s work for a little while now. The speed of improvement given the complexity of these types of systems is mind-boggling. I wonder how long it takes before Google street view gets replaced by some NeRF variant
25.
by kolja005 3y ago
From the interviews with him that I have seen, Sutskever thinks that language model is a sufficient pretraining task because there is a great deal of reasoning involved in next token prediction. The example he used was that suppose you fed
26.
by kolja005 3y ago
What has me scratching my head is the fact that Altman has been on a world tour preaching the need for safety in AI. Many people here believed that this proselytizing was in part an attempt to generate regulatory capture. But given what&#x2
27.
by kolja005 3y ago
Additionally, OpenAI can just put resources towards both approaches in order to settle this dispute. The whole point of research is that you don't know the conclusions ahead of time.
28.
by kolja005 3y ago
I was a little confused about this too. The authors say in the paper: "The outputs of the ViT image encoder before pooling form the visual tokens, which are linearly projected and prepended to the embedded input text tokens." I to
29.
by kolja005 3y ago
I probably could have guessed that contrastive pre-training works better for downstream vision-language tasks than image classification pre-training, but it's nice to see this hypothesis thoroughly tested here. Also, hacks to get LLMs
30.
by kolja005 3y ago
The purpose of this research is to compare large vision-language models where the vision component is pre-trained using different techniques, namely on image classification versus unsupervised contrastive pre-training (see OpenAI's CLI

More ›