5 ms·

I am running the 7B distilled version locally. I asked it to create a skeleton MEAN project. Everything was great but then it started to generate the front-end

I am running the 7B distilled version locally. I asked it to create a skeleton MEAN project. Everything was great but then it started to generate the front-end and I noticed the file extension (.tsx) and then saw react getting imported. I gave the same prompt to sonnet 3.5 and not a single hiccup. Maybe not an indication that Deepseek is worse/bad (I am using a distilled version), but moreso speaks to much react/nextjs is out in the world influencing the front-end code that is referenced.

rafaquintanilha 2y ago
You know you are running an extremely nerfed version of the model, right?
- leovander 2y ago
  I did update my comment, but said that I am using the distilled version, so yes?
  - cbg0 2y ago
    Even the full model scores below Claude on livebench so a distilled version will likely be even worse.
    - rsanek 2y ago
      Based on the leaderboard R1 is significantly better than Claude? https://livebench.ai/#/ https://livebench.ai/#/
      - cbg0 2y ago
        Not at coding.
satvikpendem 2y ago
You are not actually running DeepSeek, those distilled models have nothing to do with DeepSeek itself and are just finetuned on DeepSeek responses.
- dghlsakjg 2y ago
  They were finetuned by Deepseek from what I can tell.