10 ms·

Weird, I've been told you can just throw AI at all your logs and metrics and it can magically solve all the things...

by unknownfuture 1mo ago

akkad33 1mo ago
Maybe they are dedicated hand coders!
- q4wsh 1mo ago
  They were before 2023, when things worked ... So a "component" failed? That sounds like a software component. We just saw in https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug how sloppy bot coding is.
rurban 1mo ago
My blackest Monday today. Deepseek is off/too expensive, Claude tokens out for 3 days, kimi refuses, and Github down for the whole afternoon. Maybe I'll take the week off
- ALLTaken 1mo ago
  hmm very interesting combination of services being down. I've been using DeepSeek v4 Pro and Qwen3.8 now daily for close to 2 weeks. Damn good and reliable. Anytime I need to verify math I check with Kimi k3 tho, it still feels like being superior to these both, not sure if actually true.
- ajmurmann 1mo ago
  It's crazy that it wasn't that long ago that all we worked with was a compiler on the local machine and maybe a SVN server you'd interact with every few hours
  - intrasight 1mo ago
    Not that long ago that I used a local CVS server for SCCS. OK, almost 40 years - but still.
    - sillysaurusx 1mo ago
      CVS was alive and well as of 16 years ago. It was our primary source control system at S2 Games. I was shocked but it really wasn’t all that bad.
      - eterm 1mo ago
        Disadvantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Advantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Sometimes, not being able to work independently can be an advantage. Two people discovering they're trying to work on the same file can lead to useful conversations.
      - irishcoffee 1mo ago
        Oh wow did you work on HoN? I devoted many, many, many hours to that game.
        sillysaurusx 27d ago
        Sure did :) it was one of the few times when I worked on a product I truly loved. https://github.com/shawwn/noh https://github.com/shawwn/noh
        irishcoffee 27d ago
        That is so cool. I bet that was an absolute blast. Can I ask for a war story? Something hard or goofy that I as I player (and a software engineer) probably had no idea you had to solve? I really loved that game.
        sillysaurusx 27d ago
- rambojohnson 1mo ago
  [dead]
- timcobb 1mo ago
  Nvidia build might have DeepSeek capacity
hombre_fatal 1mo ago
Well, it would be a mistake on your part to assume that everything in an organization, especially a large one like github, is a reflection of the capabilities of the state of the art in anything (AI, architecture, programming language, organizational management, operations, etc.). It's clear that updating the status page as quickly as possible isn't even something github cares about.
- unknownfuture 1mo ago
  It would be a mistake to judge AI based on the performance of one of its strongest pushers and promoters? Interesting take.
  - therealdrag0 1mo ago
    My company is heavy on AI promotion, but many many many people still do things sub-optimally, and many systems are still not well integrated/able with AI. “The future is here it’s just not evenly distributed”, and that applies inside companies too. Hard to actually judge without being in the room and knowing the team that owns the incident. And as other said, it’s pretty common IME to have a root cause but slow roll communication of it until remediation has more confidence.
    - Brian_K_White 1mo ago
      It's very easy to judge in the context of how all other service providers are performing on average. It's very easy to hold any service provider responsible for their own words and deeds that no one else demanded nor commanded (selling themselves to MS, moving onto Azure, copilot stuffed into everything, the architectural garbage that is gh actions). It's very easy to judge when most of their difficulties are self-inflicted. You excuse and understand the exception, not the norm.
      - therealdrag0 29d ago
        Sure all that can be true. I’m just saying none of that implicates AI capabilities.

Weird, I've been told you can just throw AI at all your logs and metrics and it can magically solve all the things...

akkad33 1mo ago

Maybe they are dedicated hand coders!

q4wsh 1mo ago
They were before 2023, when things worked ... So a "component" failed? That sounds like a software component. We just saw in https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug https://www.wiz.io/blog/red-agent-snowflake-copilot-cicd-bug how sloppy bot coding is.

rurban 1mo ago

My blackest Monday today. Deepseek is off/too expensive, Claude tokens out for 3 days, kimi refuses, and Github down for the whole afternoon. Maybe I'll take the week off

ALLTaken 1mo ago
hmm very interesting combination of services being down. I've been using DeepSeek v4 Pro and Qwen3.8 now daily for close to 2 weeks. Damn good and reliable. Anytime I need to verify math I check with Kimi k3 tho, it still feels like being superior to these both, not sure if actually true.
ajmurmann 1mo ago
It's crazy that it wasn't that long ago that all we worked with was a compiler on the local machine and maybe a SVN server you'd interact with every few hours
- intrasight 1mo ago
  Not that long ago that I used a local CVS server for SCCS. OK, almost 40 years - but still.
  - sillysaurusx 1mo ago
    CVS was alive and well as of 16 years ago. It was our primary source control system at S2 Games. I was shocked but it really wasn’t all that bad.
    - eterm 1mo ago
      Disadvantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Advantage: You have to coordinate with teammates to make sure you don't need the same file at the same time. Sometimes, not being able to work independently can be an advantage. Two people discovering they're trying to work on the same file can lead to useful conversations.
    - irishcoffee 1mo ago
      Oh wow did you work on HoN? I devoted many, many, many hours to that game.
      - sillysaurusx 27d ago
        Sure did :) it was one of the few times when I worked on a product I truly loved. https://github.com/shawwn/noh https://github.com/shawwn/noh
        irishcoffee 27d ago
        That is so cool. I bet that was an absolute blast. Can I ask for a war story? Something hard or goofy that I as I player (and a software engineer) probably had no idea you had to solve? I really loved that game.
        sillysaurusx 27d ago
rambojohnson 1mo ago
[dead]
timcobb 1mo ago
Nvidia build might have DeepSeek capacity

hombre_fatal 1mo ago

Well, it would be a mistake on your part to assume that everything in an organization, especially a large one like github, is a reflection of the capabilities of the state of the art in anything (AI, architecture, programming language, organizational management, operations, etc.). It's clear that updating the status page as quickly as possible isn't even something github cares about.

unknownfuture 1mo ago
It would be a mistake to judge AI based on the performance of one of its strongest pushers and promoters? Interesting take.
- therealdrag0 1mo ago
  My company is heavy on AI promotion, but many many many people still do things sub-optimally, and many systems are still not well integrated/able with AI. “The future is here it’s just not evenly distributed”, and that applies inside companies too. Hard to actually judge without being in the room and knowing the team that owns the incident. And as other said, it’s pretty common IME to have a root cause but slow roll communication of it until remediation has more confidence.
  - Brian_K_White 1mo ago
    It's very easy to judge in the context of how all other service providers are performing on average. It's very easy to hold any service provider responsible for their own words and deeds that no one else demanded nor commanded (selling themselves to MS, moving onto Azure, copilot stuffed into everything, the architectural garbage that is gh actions). It's very easy to judge when most of their difficulties are self-inflicted. You excuse and understand the exception, not the norm.
    - therealdrag0 29d ago
      Sure all that can be true. I’m just saying none of that implicates AI capabilities.