7 ms·

In case the author is reading this, I have the receipts on how there's a real step function in how much software I build, especially lately. I am not going to p

by larve 1y ago

In case the author is reading this, I have the receipts on how there's a real step function in how much software I build, especially lately. I am not going to put any number on it because that makes no sense, but I certainly push a lot of code that reasonably seems to work. The reason it doesn't show up online is that I mostly write software for myself and for work, with the primary goal of making things better, not faster. More tooling, better infra, better logging, more prototyping, more experimentation, more exploration. Here's my opensource work: https://github.com/orgs/go-go-golems/repositories https://github.com/orgs/go-go-golems/repositories . These are not just one-offs (although there's plenty of those in the vibes/ and go-go-labs/ repositories), but long-lived codebases / frameworks that are building upon each other and have gone through many many iterations.

ryanobjc 1y ago
The author is pointing out that aggregate productivity hasn't really gone up. The graphs are fairly compelling. There are many reasons for your experience, and I am glad you are having them! That's great! But the fact remains, overall we aren't seeing an exponential or even step function in how much software is being delivered!
xenobeb 1y ago
What is even the point in having this argument? At this point, one is gaining with each model release or they are not. Lets see in 2035 who was right and who was wrong. My bet is the people who are not gaining right now are not going to like the situation in 2035.
nerevarthelame 1y ago
How are you sure it's increasing your productivity if it "makes no sense" to even quantify that? What are the receipts you have?
- larve 1y ago
  I have linked my github above. I don't know how that fares in the bigger scope of things, but I went from 0 opensource to hundreds of tools and frameworks and libraries. Putting a number on "productivity" makes no sense to me, I would have no idea what that means. I generate between 10-100k lines of code per day these days. But is that a measure of productivity? Not really...
  - sarchertech 1y ago
    >I generate between 10-100k lines of code per day these days. That’s absolute nonsense.
    - irthomasthomas 1y ago
      He said "generate". This is trivial to do. And probably this is what Amodei meant when he said 90% of code would be AI by now. It doesn't meant that generated code is actually useful and gets checked in.
      - larve 1y ago
        Trivial is a pretty big word in this context. Expanding an idea into some sort of code is indeed a matter of waiting. The idea, the prompt, the design of the overall workflow to leverage the capabilities of llms/agents in a professional/long-lived codebase context is far from trivial, imo.
    - larve 1y ago
      You can look at my GitHub, and I stream full unedited sessions on https://youtube.com/@program-with-ai https://youtube.com/@program-with-ai
      - saulpw 1y ago
        I tuned in to a random spot at a random episode, didn't see any coding but did get to hear you say: "I'm a person who hates art now...I never want to see art again. All I want to see is like, AI stuff. That's how bad it's gotten. Handmade? nuh-uh. Handmade code? ... anything by humans, just over. I'm just gonna watch pixels." https://www.youtube.com/live/APkR4qRg1vM?si=XLGmH9uEjG08q-6x&t=204 https://www.youtube.com/live/APkR4qRg1vM?si=XLGmH9uEjG08q-6x... I watched a little more but was, uh, not impressed.
        larve 1y ago
        I'm always a very serious person while I wait for people to join the stream. I'm sorry you weren't impressed, but tbf that's not really my goal, I just like building things and yapping about it.
trenchpilgrim 1y ago
Same. On many days 90% of my code output by lines is Claude generated and things that took me a day now take well under an hour. Also, a good chunk of my personal OSS projects are AI assisted. You probably can't tell from looking at them, because I have strict style guides that suppress the "AI style", and I don't really talk about how I use AI in the READMEs. Do you also expect I mention that I used Intellisense and syntax highlighting too?
- droidjj 1y ago
  The author’s main point is that there hasn’t been an uptick in total code shipped, as you would expect if people are 10x-ing their productivity. Whether folks admit to using AI in their workflow is irrelevant.
  - warkdarrior 1y ago
    Maybe people are working less and enjoying life more, while shipping the same amount of code as before. If someone builds a faster car tomorrow, I am not going to go to the office more often.
    - leoc 1y ago
      "In this economy?", as the saying goes.
    - jplusequalt 1y ago
      Jevon's paradox.
  - trenchpilgrim 1y ago
    The bottleneck on how much I ship has never been how fast I can write and deploy code :)
  - larve 1y ago
    Their main point is "AI coding claims don't add up", as shown by the amount of code shipped. I personally do think some of the more incredible claims about AI coding add up, and am happy to talk about it based on my "evidence", ie the software I am building. 99.99% of my code is ai generated at this point, with the occasional one line I fill in because it'd be stupid to wait for an LLM to do it. For example, I've built 5-6 iphone apps, but they're kind of one-offs and I don't know why I would put them up on the app store, since they only scratch my own itches.
noidesto 1y ago
Agree. In the hands of a seasoned dev not only does productivity improve but the quality of outputs. If I’m working against a deadline I feel more comfortable spending time on research and design knowing I can spend less time on implementation. In the end, it took the same amount of time, though hopefully with an increase of reliability, observability, and extendibility. None of these things show up in the author’s faulty dataset and experiment.
deleted 1y ago
[deleted]
philipwhiuk 1y ago
I mean it's definitely shovelware, I'll give you that. https://github.com/go-go-golems/ai-in-action-app/blob/main/cmd/server/main.go https://github.com/go-go-golems/ai-in-action-app/blob/main/c...
- larve 1y ago
  Not sure what you mean? This was a demo in a live session that took about 30 minutes, including ui ideation (see pngs). It’s a reasonably well featured app and the code is fairly minimal. I wouldn’t be able to write something like that in 30 minutes by hand.

by larve 1y ago

ryanobjc 1y ago

The author is pointing out that aggregate productivity hasn't really gone up. The graphs are fairly compelling. There are many reasons for your experience, and I am glad you are having them! That's great! But the fact remains, overall we aren't seeing an exponential or even step function in how much software is being delivered!

xenobeb 1y ago

What is even the point in having this argument? At this point, one is gaining with each model release or they are not. Lets see in 2035 who was right and who was wrong. My bet is the people who are not gaining right now are not going to like the situation in 2035.

nerevarthelame 1y ago

How are you sure it's increasing your productivity if it "makes no sense" to even quantify that? What are the receipts you have?

larve 1y ago
I have linked my github above. I don't know how that fares in the bigger scope of things, but I went from 0 opensource to hundreds of tools and frameworks and libraries. Putting a number on "productivity" makes no sense to me, I would have no idea what that means. I generate between 10-100k lines of code per day these days. But is that a measure of productivity? Not really...
- sarchertech 1y ago
  >I generate between 10-100k lines of code per day these days. That’s absolute nonsense.
  - irthomasthomas 1y ago
    He said "generate". This is trivial to do. And probably this is what Amodei meant when he said 90% of code would be AI by now. It doesn't meant that generated code is actually useful and gets checked in.
    - larve 1y ago
      Trivial is a pretty big word in this context. Expanding an idea into some sort of code is indeed a matter of waiting. The idea, the prompt, the design of the overall workflow to leverage the capabilities of llms/agents in a professional/long-lived codebase context is far from trivial, imo.
  - larve 1y ago
    You can look at my GitHub, and I stream full unedited sessions on https://youtube.com/@program-with-ai https://youtube.com/@program-with-ai
    - saulpw 1y ago
      I tuned in to a random spot at a random episode, didn't see any coding but did get to hear you say: "I'm a person who hates art now...I never want to see art again. All I want to see is like, AI stuff. That's how bad it's gotten. Handmade? nuh-uh. Handmade code? ... anything by humans, just over. I'm just gonna watch pixels." https://www.youtube.com/live/APkR4qRg1vM?si=XLGmH9uEjG08q-6x&t=204 https://www.youtube.com/live/APkR4qRg1vM?si=XLGmH9uEjG08q-6x... I watched a little more but was, uh, not impressed.
      - larve 1y ago
        I'm always a very serious person while I wait for people to join the stream. I'm sorry you weren't impressed, but tbf that's not really my goal, I just like building things and yapping about it.

trenchpilgrim 1y ago

Same. On many days 90% of my code output by lines is Claude generated and things that took me a day now take well under an hour. Also, a good chunk of my personal OSS projects are AI assisted. You probably can't tell from looking at them, because I have strict style guides that suppress the "AI style", and I don't really talk about how I use AI in the READMEs. Do you also expect I mention that I used Intellisense and syntax highlighting too?

droidjj 1y ago
The author’s main point is that there hasn’t been an uptick in total code shipped, as you would expect if people are 10x-ing their productivity. Whether folks admit to using AI in their workflow is irrelevant.
- warkdarrior 1y ago
  Maybe people are working less and enjoying life more, while shipping the same amount of code as before. If someone builds a faster car tomorrow, I am not going to go to the office more often.
  - leoc 1y ago
    "In this economy?", as the saying goes.
  - jplusequalt 1y ago
    Jevon's paradox.
- trenchpilgrim 1y ago
  The bottleneck on how much I ship has never been how fast I can write and deploy code :)
- larve 1y ago
  Their main point is "AI coding claims don't add up", as shown by the amount of code shipped. I personally do think some of the more incredible claims about AI coding add up, and am happy to talk about it based on my "evidence", ie the software I am building. 99.99% of my code is ai generated at this point, with the occasional one line I fill in because it'd be stupid to wait for an LLM to do it. For example, I've built 5-6 iphone apps, but they're kind of one-offs and I don't know why I would put them up on the app store, since they only scratch my own itches.

noidesto 1y ago

Agree. In the hands of a seasoned dev not only does productivity improve but the quality of outputs. If I’m working against a deadline I feel more comfortable spending time on research and design knowing I can spend less time on implementation. In the end, it took the same amount of time, though hopefully with an increase of reliability, observability, and extendibility. None of these things show up in the author’s faulty dataset and experiment.

deleted 1y ago

[deleted]

philipwhiuk 1y ago

I mean it's definitely shovelware, I'll give you that. https://github.com/go-go-golems/ai-in-action-app/blob/main/cmd/server/main.go https://github.com/go-go-golems/ai-in-action-app/blob/main/c...

larve 1y ago
Not sure what you mean? This was a demo in a live session that took about 30 minutes, including ui ideation (see pngs). It’s a reasonably well featured app and the code is fairly minimal. I wouldn’t be able to write something like that in 30 minutes by hand.