10 ms·

Cerebras Code

449 points by d3vr 1y ago

namanyayg 1y ago
I was waiting for more subscription base services to pop up to compete with the influence provider on a commodities level. I think a lot more companies will follow suit and the competition will make pricing much better for the end user. congrats on the launch Cerebras team!
sophia01 1y ago
My understanding is that the coding agents people use can be modified to plug into any LLM provider's API? The difference here seems to be that Cerebras does not appear to have Qwen3-Coder through their API! So now there is a crazy fast (and apparently good too?) model that they only provide if you pay the crazy monthly sub?
- baq 1y ago
  define 'crazy'. it's two kilotokens per second. that's fast.
  - ttoinou 1y ago
    I’d say super fast
  - bangaladore 1y ago
    It's more than 10x faster than the fastest alternative. And roughly 50x the average alternative. Certainly, somewhere between fast and crazy.
  - amelius 1y ago
    It generates code faster than I can inspect it. In other words, it's needlessly fast.
    - pxc 1y ago
      You might be able to use the extra time to have it do things like run some formatters, linters, run the code in a VM before you inspect it, or modify it for compliance with a style guide that you've written, and continually revise it for up to 5 tries until the conditions are met, something like that. So maybe there's something useful to do with the extra speed. But it does seem more "useful" for vibe coding than for writing usable/good code.
- pxc 1y ago
  You can still get it pay-as-you-go on OpenRouter, afaict, and the billing section of the Cerebras Cloud account I just created has a section for Qwen3-Coder-480B as well.
  - sophia01 1y ago
    Yeah just checked apparently it is available as a preview (not on main models/pricing page).
- social_quotient 1y ago
  Exactly! You can use tools like https://github.com/musistudio/claude-code-router https://github.com/musistudio/claude-code-router which let you use other LLMs. The way I would use this $50 Cerebras offering is as a delegate for some high token count items like documentation, lint fixing, and other operations as a way not only to speed up the workflow but to release some back pressure on Anthropic/claude so you don’t hit your limits as quickly… especially with the new weekly throttle coming. This $50 dollar jump seems very reasonable, now for the 1k completions a day, id really want to see and get a feel for how chatty it is. I suppose thats how it starts but id the model is competent and fast, the speed alone might force you a bit to delegate more to it. (Maybe sub agent tasks)
JackYoustra 1y ago
I've been waiting on this for a LONG time. Integration with Cursor when Cerebras released their earlier models was patchy at best, even through openrouter. It's nice to finally see official support, although I'm a bit worried about long-term the time for bash mcp calls ending up dominating. Still, definitely the right direction! EDIT: doesn't seem like anything but a first-party api with a monthly plan.
ktsakas 1y ago
Does it work with claude-code-router? I was getting API errors this week trying to use qwen3 Cerebras through OpenRouter with Claude code router.
- amirhirsch 1y ago
  API Error: 422 {"error":{"message":"Error from provider: {\"message\":\"body.messages.0.system.content: Input should be a valid string\",\"type\":\"invalid_request_error\",\"param\":\"validation_error\",\"code\":\"wrong_api_format\"}
  - amirhirsch 1y ago
    i ended up getting it working through copying the transformer in this issue: https://github.com/musistudio/claude-code-router/issues/407 https://github.com/musistudio/claude-code-router/issues/407 It hits the request per minute limit instantly and then you wait a minute.
    - nubela 1y ago
      Did you make payment? I also found it unusable due to rate limits. Not sure if it is because I was on the free trial.
- d4rkp4ttern 1y ago
  I really wish Qwen3 folks put up an Anthropic-compatible API like the Kimi and GLM/Zai folks cleverly did — this makes their models trivially usable in Claude Code, via this dead-simple setup: https://github.com/pchalasani/claude-code-tools?tab=readme-ov-file#-using-claude-code-with-open-weight-anthropic-api-compatible-llm-providers https://github.com/pchalasani/claude-code-tools?tab=readme-o...
thanhhaimai 1y ago
> running at speeds of up to 2,000 tokens per second, with a 131k-token context window, no proprietary IDE lock-in, and no weekly limits! I was excited, then I read this: > Send up to 1,000 messages per day—enough for 3–4 hours of uninterrupted vibe coding. I don't mind paying for services I use. But it's hard to take this seriously when the first paragraph claim is contradicting the fine prints.
- amirhirsch 1y ago
  the distinction is from weekly limits of claude code.
  - sneilan1 1y ago
    Claude code weekly limits are hard to distinguish. It's not easy to understand their usage limits. I've found when I run into too much opus usage, I switch to sonnet but I've never ran into a usage limit with sonnet 4 yet.
- sneilan1 1y ago
  1,000 messages per day should be plenty as a daily development driver. I use claude code sonnet 4 exclusively and I do not send more than 1,000 messages per day. However, that is my current understanding. I am certainly not pressing enter 1,000 times! Maybe there are more messages being sent under the hood that I do not realize?
  - SamDc73 1y ago
    Still not sure if it's 1000 messages or calls though, if messages that's good.
    - diggan 1y ago
      Neither, it seems. The blog post says "Send up to N messages per day", but the FAQ (https://cerebras-inference.help.usepylon.com/articles/3468865440-how-do-you-calculate-messages-per-day https://cerebras-inference.help.usepylon.com/articles/346886...) says: > How do you calculate messages per day? Actual number of messages per day depends on token usage per request. Estimates based on average requests of ~8k tokens each for a median user. So seems there is a token limit? But they're not clear what exactly that is? Haven't tried to subscribe, just going by public information available.
dude250711 1y ago
[flagged]
- fishsticks89 1y ago
  It will just be replaced by more vibe code in the future. Code is like toilet paper now.
- reactordev 1y ago
  Nah, we’ll have a Legacy Coder agent to fix vibe coding agents so you’ll be supervising those. Yey…
- andrewmutz 1y ago
  If you review every change as it goes, vibecoded results are often better than human-only and written much faster
  - jbc1 1y ago
    If you’re reviewing every change then what does “vibe coding” even mean?
    - chpatrick 1y ago
      It's not like human code doesn't need review.
      - jazzyjackson 1y ago
        the usage of vibe coding in my experience is towards those folks who run whatever the AI produced and if it does what they expect without throwing errors they ship it. If it throws errors they plug that back into the chatbot until the code stops throwing errors. The whole point of vibe coding is its working faster than you would on your own. If you're reviewing it carefully and understand how it works, you might as well have written it by hand.
        1y ago
sneilan1 1y ago
I'm so excited to see a real competitor to Claude Code! Gemini CLI, while decent, does not have a $200/month pricing model and they charge per API access - Codex is the same. I'm trying to get into the https://cloud.cerebras.ai/ https://cloud.cerebras.ai/ to try the $50/month plan but I can't even get in.
- bangaladore 1y ago
  Unless I'm misunderstanding something. Cerebras Code is not equivalent to Claude Code or Gemini CLI. It's a strange name for a subscription to access an API endpoint. You take your Cerebras Code endpoint and configure XYZ CLI tool or IDE plugin to point at it.
  - sneilan1 1y ago
    Oh so this is not an integrated command line tool like Claude code? I assumed it was something where Cerebras released a decent prompt and command line agent setup. A lot of the value of Claude Code is how polished it is and how much work went into the prompt design.
    - unshavedyak 1y ago
      There is i believe a forked Gemini Code which will work like Claude Code, or so it looks like on Youtube.
      - d4rkp4ttern 1y ago
        Yes it’s called OpenCode and today I was surprised to learn it works with Claude Pro/Max subscriptions: https://opencode.ai/docs/ https://opencode.ai/docs/
        dcre 1y ago
        OpenCode is not a fork of the Gemini CLI. It is its own thing.
alfalfasprout 1y ago
2k tokens/second is insane. While I'm very much against vibe coding, such performance essentially means you can get near-github copilot level speed with drastically better quality. For in-editor use that's game changing.
- itsafarqueue 1y ago
  At full pace that means 62 mins until you hit the daily cap.
  - kvemkon 1y ago
    Reminds me of high write speed on SSD (1.5 GB/s continuously to TLC) means 1 TB SSD warranty expires instead of 5 years just in less than 5 days (600 TB written).
    - sliken 1y ago
      Or comcast's 1 gb service with a 1TB limit, which means you hit the limit in 140 minutes at full rate.
knicholes 1y ago
It says it works with your favorite IDE-- How do you (the reader) plan to use this? I use Cursor, but I'm not sure if this replaces my need to pay for Cursor, or if I need to pay for Cursor AND this, and add in the LLM? Or is VS code pretty good at this point? Or is there something better? These are the only two ways I'd know how to actually consume this with any success.
- alfalfasprout 1y ago
  any plugin that allows using an OpenAI compatible endpoint should work fine (eg; RooCode, Cline, etc. for VSCode). Personally, I use code-companion on neovim. Maybe not the best solution for vibe coders but for serious engineers using these tools for AI-assisted development, OpenAI API compatibility means total flexibility.
HardCodedBias 1y ago
This has to be a monstrous money loser. If they can maintain this pricing level, and if Qwen3‑Coder is as good as people say then they will have an enormous hit on their hands. A massive money losing hit, but a hit. Very interesting! PS: Did they reduce the context window, it looks like it.
- kristopolous 1y ago
  They are a hardware company. They have a custom chip they are running it on. The $200/month is their "poor person" product for people who can't shell out $500k on one of their rigs. https://www.cerebras.ai/system https://www.cerebras.ai/system
  - HardCodedBias 1y ago
    I know. These things are unbelievable machines. The people at Cerebras are fearless wrt. taking on difficult hardware challenges. But this will certainly be a money loser. They have likely been waiting for an open source model that somewhat conforms to their hardware's limitations and which gives acceptable recommendations. It looks like they have found it with QWEN. We'll see!
    - bdcravens 1y ago
      OpenAI lost around $5B last year. https://www.lesswrong.com/posts/CCQsQnCMWhJcCFY9x/openai-lost-usd5-billion-in-2024-and-its-losses-are https://www.lesswrong.com/posts/CCQsQnCMWhJcCFY9x/openai-los...
- UnPerson-Alpha2 1y ago
  Honest ? What are you thinking in terms of cost structure that makes you sure it is a money loser? Can you break down your assumptions.
- ahmadyan 1y ago
  Why? For $200plan, it has 40M token cap per day, so assuming the API pricing, the max usage per day is $12/day or 360 per month. (Assuming user max-out usage every day or doesn't hit the 1000message limit first) relatively standard subscription pricing vs API pricing, i believe they are making money from this and counting on people compare this to Claude Code, which is a much more generous offer.
supernova8 1y ago
How is this even possible?
- kristopolous 1y ago
  It's their own hardware : https://www.cerebras.ai/blog/cerebras-cs3 https://www.cerebras.ai/blog/cerebras-cs3
- unshavedyak 1y ago
  Incase i'm missing something, why wouldn't it be possible? Claude and Gemini have similar offerings for a similar/same price, i thought. Eg if Claude Code can do it for $200/m, why can't Cerebras? (honest question, trying to understand the challenge for Cerebras that you're pointing to) edit: Maybe it's the speed? 2k tokens/s sounds... fast, much faster than Claude. Is that what you're referring to?
  - UnPerson-Alpha2 1y ago
    He just wrote another way of making an exclamation, like "wow, incredible!".
- meepmorp 1y ago
  They make frisbee-sized CPUs.
  - sliken 1y ago
    Indeed. Pretty much all silicon today comes on 12" or so wafers, broken into chip sized pieces, and each chip is tested and the ones that failed are thrown away. Cerebras uses the entire 12" and builds in redundancy so that with current defect rates a large fraction of the wafers are usable. This allows a huge level of parallelism, a large amount of on board ram, and the removal of the need to move data on/off the wafer. So the available bandwidth is insane and inference is mostly bandwidth limited.
clbrmbr 1y ago
At $200/month the comparable should be Opus 4 not Sonnet 4.
- rowanG077 1y ago
  Not really. With Opus 4 you will burn into the thousand a month with serious usage. I tested it yesterday and 5 hours of use was 60$. If I extrapolate that you will easily hit 1K+.
  - lordofgibbons 1y ago
    Are you comparing using opus via API based usage vs opus via the $200/mo plan?
    - rowanG077 1y ago
      I didn't know anthropic offered a fixed price version.
unshavedyak 1y ago
Super curious to see some comparisons to claude code. Especially Opus, since they're primarily comparing it to Sonnet in that graph.
dpkirchner 1y ago
For those that have tried this, what kind of time-to-first-token latency are you seeing?
- txyx303 1y ago
  feels very low compared to claude/gpt for me
- anonym29 1y ago
  I had 9 seconds, earlier with Cline. That said, resulting output file I had requested generation of was over 122KB in 58.690 seconds, so I was approaching 2KB per second even factoring in high TTFT.
- M4v3R 1y ago
  The high TTFT (around 5-6 seconds) is what kills the excitement for this for me. Sure, when it starts outputting its crazy fast so it’s good for generating single file prototypes, but as soon as you try to use it in Cline or any other agentic loop you’ll be waiting for API requests constantly and it’s a real bottleneck.
  - hollerith 1y ago
    TTFT == time to first token. (I would've just said, "the throughput is fantastic, but the latency is about 3 times higher than other offerings".)
crawshaw 1y ago
If you would like to try this in a coding agent (we find the qwen3-coder model works really well in agents!), we have been experimenting with Cerebras Code in Sketch. We just pushed support, so you can run it with the latest version, 0.0.33: brew install boldsoftware/tap/sketch CEREBRAS_API_KEY=... sketch --model=qwen3-coder-cerebras -skaband-addr= Our experience is it seems overloaded right now, to the point where we have better results with our usual hosted version: sketch --model=qwen
lvl155 1y ago
Their hardware is incredible. Why aren’t more investors lining up for this in this environment?
- dmitrygr 1y ago
  Contradictions do not exist. Whenever you think that you are facing a contradiction, check your premises. You will find that one of them is wrong.
  - deleted 1y ago
    [deleted]
  - thfuran 1y ago
    Neither do perfectly efficient, perfectly rational markets.
    - sejje 1y ago
      A perfectly efficient market would be a bad premise, sure.
  - orbifold 1y ago
    In this case the hardware is a nightmare to program.
    - dmitrygr 1y ago
      Bingo
  - arisAlexis 1y ago
    Or just bad marketing vs the Goliath (Nvidia)
  - Invictus0 1y ago
    Kurt Gödel would like a word
- 1y ago
lxe 1y ago
Is this available as cline/roo-code integration? I think it might be on openrouter too.
- d3vr 1y ago
  Cline support added in v3.20.4: https://github.com/cline/cline/releases/tag/v3.20.4 https://github.com/cline/cline/releases/tag/v3.20.4 Roo Code support added in v3.25.5: https://github.com/RooCodeInc/Roo-Code/releases/tag/v3.25.5 https://github.com/RooCodeInc/Roo-Code/releases/tag/v3.25.5 Cerebras has also been added as a provider for Qwen 3 Coder in OpenRouter: https://openrouter.ai/qwen/qwen3-coder?sort=throughput https://openrouter.ai/qwen/qwen3-coder?sort=throughput
  - d3vr 1y ago
    BTW you can also go through HuggingFace: https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct?inference_provider=cerebras https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct?i...
scosman 1y ago
Groq also probably has this in the works. Fun times.
- Consumer-Basics 1y ago
  Verified or just a thought?
Flux159 1y ago
Tried this out with Cline using my own API key (Cerebras is also available as a provider for Qwen3 Coder via via openrouter here: https://openrouter.ai/qwen/qwen3-coder https://openrouter.ai/qwen/qwen3-coder) and realized that without caching, this becomes very expensive very quickly. Specifically, after each new tool call, you're sending the entire previous message history as input tokens - which are priced at $2/1M via the API just like output tokens. The quality is also not quite what Claude Code gave me, but the speed is definitely way faster. If Cerebras supported caching & reduced token pricing for using the cache I think I would run this more, but right now it's too expensive per agent run.
- Havoc 1y ago
  This seems to be rate limited by message not token so the lack of cache may matter less
  - deleted 1y ago
    [deleted]
  - Flux159 1y ago
    The lack of caching causes the price to increase for each message or tool call in a chat because you need to send the entire history back after every tool call. Because there isn’t any discount for cached tokens you’re looking at very expensive chat threads.
  - NitpickLawyer 1y ago
    Yes, but the new "thing" now is "agentic" where the driver is "tool use". So at every point where the LLM decides to make a tool use, there is a new request that gets sent. So a simple task where the model needs to edit one function down the tree, there might be 10 calls - 1st with the task, 2-5 for "read_file", then the model starts writing code, 6-7 trying to run the code, 8 fixing something, and so on...
    - itsafarqueue 1y ago
      Yup. If you’ve ever watched a 60+ minute agent loop spawning sub agents, your “one message” prompt leaves you several hundred messages in the hole.
cellis 1y ago
What are the token prices?
- anonym29 1y ago
  $2/Mtok in and out but no caching discounts
deevus 1y ago
I'm finding myself switching between subscriptions to ChatGPT, T3 Chat, DeepSeek, Claude Code etc. Their subscription models aren't compatible with making it easy to take your data with you. I wish I could try this out and import all my data.
atkailash 1y ago
I use regular cerebras for plan stage in cline, so I’m very excited to try this out
attentive 1y ago
Attn: Cerebras Any attempt to deal with "<think>" in the code gets it replaced with "<tool_call>". Both in inference.cerebras.ai chat and API. Same model on chat.qwen.ai doesn't do it.
unraveller 1y ago
Some users who signed up for pro ($50 p.m.) are reporting further limitations than those advertised. >While they advertise a 1,000-request limit, the actual daily constraint is a 7.5 million-token limit. [1] Assumes an average of 7.5k/request whereas in their marketing videos they show API requests ballooning by ~24k per request. Still lower than the API price. [1] https://old.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebras_pro_coder_deceptive_limits/ https://old.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebra...
- itsafarqueue 1y ago
  Bait and switched their FAQ after the fact too. Come on Cerebras, it’s only VC money you’re burning here in the first place, let’s see some commitment to winning market share. :money: :fire:
- apwell23 1y ago
  shocking..
- nickandbro 1y ago
  Had a similar experience. I got rate limited as well even when I well below 1M tokens. When its working, it's nice, but can't use it as a replacement for Cursor until higher rate limits are granted.
esafak 1y ago
They should just host all the latest open source models FTW.
hexagrams64 1y ago
[dead]
segmondy 1y ago
FYI, you are probably going to use up your tokens because there's a total limit of tokens per day, so in about 300 requests it's feasible to use it all up. See https://www.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebras_pro_coder_deceptive_limits/ https://www.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebra...
exclipy 1y ago
Windsurf also has Cerebras/Qwen3-Coder. 1000 user messages per month for $15 https://x.com/windsurf/status/1951340259192742063 https://x.com/windsurf/status/1951340259192742063
- bluelightning2k 1y ago
  This is awesome. I still use windsurf and like it. Their tab model is really good
evrennetwork 1y ago
[dead]
another_twist 1y ago
How does context buildup work for the code generating machines generally ? Do the programs just use human notes + current code directly ? Are there some specific ranking steps that need to be done ?
jedisct1 1y ago
I'm a little bit confused. I subscribed to the $50 plan. It's super fast for sure, but rate limits kick in after just a couple requests. completely defeating the fact that responses are fast. Did I miss something?
- TacticalCoder 1y ago
  [dead]
saberience 1y ago
Ok it's fast, but rate limits seem to kick in extremely quickly and the results are less good than Claude Code and it ends up more expensive? Who is the intended audience for Cerebras?
- ritenuto 1y ago
  While I’m also curious, I’m fine with having a mostly inferior alternative too. This is a dynamic market with some big players already; having more options is beneficial. If only as a way to prevent others from doing a rug pull.
ixel 1y ago
The usage limit on Cerebras Code is rather limited, $50 plan apparently gives you 7.5 million tokens per day which doesn't last long. This also isn't clearly advertised on the plans prior to purchasing.
- d3vr 1y ago
  Yeah really disappointing, hopefully they'll reconsider this limit because it really isn't usable, especially with "agentic tools" (e.g: opencode) ..
romanovcode 1y ago
> and no weekly limits! No weekly limits so far. Just you wait if you get same or more traction as Claude you are going to go same playbook as they did.
scosman 1y ago
Anyone get this working in Cursor? I can connect openrouter just fine, but Cerebras just errors out instantly. Same url/key works via curl, so some sort of Cerebras/Cursor compatibility issue.
- dlojudice 1y ago
  Same here. Got this msg on the Celebras discord: > Yeah I filed a ticket with Cursor > They have problems with OpenAI customization
hereme888 1y ago
So for <$1.7/day I can hire a programmer at a sort-of Claude Sonnet 4 level? I know it's got its quirks, limits, and needs supervision, but it's like 20x cheaper than an average programmer.
- tbarbugli 1y ago
  ofc it depends where you would hire, for me (NL) its above 100x more efficient
rbitar 1y ago
This token throughput is incredible and going to set a new bar in the industry. The main issue with the cerebras code plan is that number of requests/minute is throttled, and with agentic coding systems each tool call is treated as new "message" so you can easily hit the api limits (10 messages/minute). One workaround we're doing now that seems to work is use claude for all tasks but delegate specific tools with cerebras/qwen-3-coder-480b model to generate files or other token heavy tasks to avoid spiking the total number of requests. This has cost and latency consequences (and adds complexity to the code), but until those throttle limits are lifted seems to be a good combo. I also find that claude has better quality with tool selection when the number of tools required is > 15 which our current setup has.
- deleted 1y ago
  [deleted]

449 points by d3vr 1y ago

I was waiting for more subscription base services to pop up to compete with the influence provider on a commodities level. I think a lot more companies will follow suit and the competition will make pricing much better for the end user. congrats on the launch Cerebras team!

sophia01 1y ago

My understanding is that the coding agents people use can be modified to plug into any LLM provider's API? The difference here seems to be that Cerebras does not appear to have Qwen3-Coder through their API! So now there is a crazy fast (and apparently good too?) model that they only provide if you pay the crazy monthly sub?

baq 1y ago
define 'crazy'. it's two kilotokens per second. that's fast.
- ttoinou 1y ago
  I’d say super fast
- bangaladore 1y ago
  It's more than 10x faster than the fastest alternative. And roughly 50x the average alternative. Certainly, somewhere between fast and crazy.
- amelius 1y ago
  It generates code faster than I can inspect it. In other words, it's needlessly fast.
  - pxc 1y ago
    You might be able to use the extra time to have it do things like run some formatters, linters, run the code in a VM before you inspect it, or modify it for compliance with a style guide that you've written, and continually revise it for up to 5 tries until the conditions are met, something like that. So maybe there's something useful to do with the extra speed. But it does seem more "useful" for vibe coding than for writing usable/good code.
pxc 1y ago
You can still get it pay-as-you-go on OpenRouter, afaict, and the billing section of the Cerebras Cloud account I just created has a section for Qwen3-Coder-480B as well.
- sophia01 1y ago
  Yeah just checked apparently it is available as a preview (not on main models/pricing page).
social_quotient 1y ago
Exactly! You can use tools like https://github.com/musistudio/claude-code-router https://github.com/musistudio/claude-code-router which let you use other LLMs. The way I would use this $50 Cerebras offering is as a delegate for some high token count items like documentation, lint fixing, and other operations as a way not only to speed up the workflow but to release some back pressure on Anthropic/claude so you don’t hit your limits as quickly… especially with the new weekly throttle coming. This $50 dollar jump seems very reasonable, now for the 1k completions a day, id really want to see and get a feel for how chatty it is. I suppose thats how it starts but id the model is competent and fast, the speed alone might force you a bit to delegate more to it. (Maybe sub agent tasks)

JackYoustra 1y ago

I've been waiting on this for a LONG time. Integration with Cursor when Cerebras released their earlier models was patchy at best, even through openrouter. It's nice to finally see official support, although I'm a bit worried about long-term the time for bash mcp calls ending up dominating. Still, definitely the right direction! EDIT: doesn't seem like anything but a first-party api with a monthly plan.

ktsakas 1y ago

Does it work with claude-code-router? I was getting API errors this week trying to use qwen3 Cerebras through OpenRouter with Claude code router.

amirhirsch 1y ago
API Error: 422 {"error":{"message":"Error from provider: {\"message\":\"body.messages.0.system.content: Input should be a valid string\",\"type\":\"invalid_request_error\",\"param\":\"validation_error\",\"code\":\"wrong_api_format\"}
- amirhirsch 1y ago
  i ended up getting it working through copying the transformer in this issue: https://github.com/musistudio/claude-code-router/issues/407 https://github.com/musistudio/claude-code-router/issues/407 It hits the request per minute limit instantly and then you wait a minute.
  - nubela 1y ago
    Did you make payment? I also found it unusable due to rate limits. Not sure if it is because I was on the free trial.
d4rkp4ttern 1y ago
I really wish Qwen3 folks put up an Anthropic-compatible API like the Kimi and GLM/Zai folks cleverly did — this makes their models trivially usable in Claude Code, via this dead-simple setup: https://github.com/pchalasani/claude-code-tools?tab=readme-ov-file#-using-claude-code-with-open-weight-anthropic-api-compatible-llm-providers https://github.com/pchalasani/claude-code-tools?tab=readme-o...

thanhhaimai 1y ago

> running at speeds of up to 2,000 tokens per second, with a 131k-token context window, no proprietary IDE lock-in, and no weekly limits! I was excited, then I read this: > Send up to 1,000 messages per day—enough for 3–4 hours of uninterrupted vibe coding. I don't mind paying for services I use. But it's hard to take this seriously when the first paragraph claim is contradicting the fine prints.

amirhirsch 1y ago
the distinction is from weekly limits of claude code.
- sneilan1 1y ago
  Claude code weekly limits are hard to distinguish. It's not easy to understand their usage limits. I've found when I run into too much opus usage, I switch to sonnet but I've never ran into a usage limit with sonnet 4 yet.
sneilan1 1y ago
1,000 messages per day should be plenty as a daily development driver. I use claude code sonnet 4 exclusively and I do not send more than 1,000 messages per day. However, that is my current understanding. I am certainly not pressing enter 1,000 times! Maybe there are more messages being sent under the hood that I do not realize?
- SamDc73 1y ago
  Still not sure if it's 1000 messages or calls though, if messages that's good.
  - diggan 1y ago
    Neither, it seems. The blog post says "Send up to N messages per day", but the FAQ (https://cerebras-inference.help.usepylon.com/articles/3468865440-how-do-you-calculate-messages-per-day https://cerebras-inference.help.usepylon.com/articles/346886...) says: > How do you calculate messages per day? Actual number of messages per day depends on token usage per request. Estimates based on average requests of ~8k tokens each for a median user. So seems there is a token limit? But they're not clear what exactly that is? Haven't tried to subscribe, just going by public information available.

dude250711 1y ago

[flagged]

fishsticks89 1y ago
It will just be replaced by more vibe code in the future. Code is like toilet paper now.
reactordev 1y ago
Nah, we’ll have a Legacy Coder agent to fix vibe coding agents so you’ll be supervising those. Yey…
andrewmutz 1y ago
If you review every change as it goes, vibecoded results are often better than human-only and written much faster
- jbc1 1y ago
  If you’re reviewing every change then what does “vibe coding” even mean?
  - chpatrick 1y ago
    It's not like human code doesn't need review.
    - jazzyjackson 1y ago
      the usage of vibe coding in my experience is towards those folks who run whatever the AI produced and if it does what they expect without throwing errors they ship it. If it throws errors they plug that back into the chatbot until the code stops throwing errors. The whole point of vibe coding is its working faster than you would on your own. If you're reviewing it carefully and understand how it works, you might as well have written it by hand.
      - 1y ago

sneilan1 1y ago

I'm so excited to see a real competitor to Claude Code! Gemini CLI, while decent, does not have a $200/month pricing model and they charge per API access - Codex is the same. I'm trying to get into the https://cloud.cerebras.ai/ https://cloud.cerebras.ai/ to try the $50/month plan but I can't even get in.

bangaladore 1y ago
Unless I'm misunderstanding something. Cerebras Code is not equivalent to Claude Code or Gemini CLI. It's a strange name for a subscription to access an API endpoint. You take your Cerebras Code endpoint and configure XYZ CLI tool or IDE plugin to point at it.
- sneilan1 1y ago
  Oh so this is not an integrated command line tool like Claude code? I assumed it was something where Cerebras released a decent prompt and command line agent setup. A lot of the value of Claude Code is how polished it is and how much work went into the prompt design.
  - unshavedyak 1y ago
    There is i believe a forked Gemini Code which will work like Claude Code, or so it looks like on Youtube.
    - d4rkp4ttern 1y ago
      Yes it’s called OpenCode and today I was surprised to learn it works with Claude Pro/Max subscriptions: https://opencode.ai/docs/ https://opencode.ai/docs/
      - dcre 1y ago
        OpenCode is not a fork of the Gemini CLI. It is its own thing.

alfalfasprout 1y ago

2k tokens/second is insane. While I'm very much against vibe coding, such performance essentially means you can get near-github copilot level speed with drastically better quality. For in-editor use that's game changing.

itsafarqueue 1y ago
At full pace that means 62 mins until you hit the daily cap.
- kvemkon 1y ago
  Reminds me of high write speed on SSD (1.5 GB/s continuously to TLC) means 1 TB SSD warranty expires instead of 5 years just in less than 5 days (600 TB written).
  - sliken 1y ago
    Or comcast's 1 gb service with a 1TB limit, which means you hit the limit in 140 minutes at full rate.

knicholes 1y ago

It says it works with your favorite IDE-- How do you (the reader) plan to use this? I use Cursor, but I'm not sure if this replaces my need to pay for Cursor, or if I need to pay for Cursor AND this, and add in the LLM? Or is VS code pretty good at this point? Or is there something better? These are the only two ways I'd know how to actually consume this with any success.

alfalfasprout 1y ago
any plugin that allows using an OpenAI compatible endpoint should work fine (eg; RooCode, Cline, etc. for VSCode). Personally, I use code-companion on neovim. Maybe not the best solution for vibe coders but for serious engineers using these tools for AI-assisted development, OpenAI API compatibility means total flexibility.

HardCodedBias 1y ago

This has to be a monstrous money loser. If they can maintain this pricing level, and if Qwen3‑Coder is as good as people say then they will have an enormous hit on their hands. A massive money losing hit, but a hit. Very interesting! PS: Did they reduce the context window, it looks like it.

kristopolous 1y ago
They are a hardware company. They have a custom chip they are running it on. The $200/month is their "poor person" product for people who can't shell out $500k on one of their rigs. https://www.cerebras.ai/system https://www.cerebras.ai/system
- HardCodedBias 1y ago
  I know. These things are unbelievable machines. The people at Cerebras are fearless wrt. taking on difficult hardware challenges. But this will certainly be a money loser. They have likely been waiting for an open source model that somewhat conforms to their hardware's limitations and which gives acceptable recommendations. It looks like they have found it with QWEN. We'll see!
  - bdcravens 1y ago
    OpenAI lost around $5B last year. https://www.lesswrong.com/posts/CCQsQnCMWhJcCFY9x/openai-lost-usd5-billion-in-2024-and-its-losses-are https://www.lesswrong.com/posts/CCQsQnCMWhJcCFY9x/openai-los...
UnPerson-Alpha2 1y ago
Honest ? What are you thinking in terms of cost structure that makes you sure it is a money loser? Can you break down your assumptions.
ahmadyan 1y ago
Why? For $200plan, it has 40M token cap per day, so assuming the API pricing, the max usage per day is $12/day or 360 per month. (Assuming user max-out usage every day or doesn't hit the 1000message limit first) relatively standard subscription pricing vs API pricing, i believe they are making money from this and counting on people compare this to Claude Code, which is a much more generous offer.

supernova8 1y ago

How is this even possible?

kristopolous 1y ago
It's their own hardware : https://www.cerebras.ai/blog/cerebras-cs3 https://www.cerebras.ai/blog/cerebras-cs3
unshavedyak 1y ago
Incase i'm missing something, why wouldn't it be possible? Claude and Gemini have similar offerings for a similar/same price, i thought. Eg if Claude Code can do it for $200/m, why can't Cerebras? (honest question, trying to understand the challenge for Cerebras that you're pointing to) edit: Maybe it's the speed? 2k tokens/s sounds... fast, much faster than Claude. Is that what you're referring to?
- UnPerson-Alpha2 1y ago
  He just wrote another way of making an exclamation, like "wow, incredible!".
meepmorp 1y ago
They make frisbee-sized CPUs.
- sliken 1y ago
  Indeed. Pretty much all silicon today comes on 12" or so wafers, broken into chip sized pieces, and each chip is tested and the ones that failed are thrown away. Cerebras uses the entire 12" and builds in redundancy so that with current defect rates a large fraction of the wafers are usable. This allows a huge level of parallelism, a large amount of on board ram, and the removal of the need to move data on/off the wafer. So the available bandwidth is insane and inference is mostly bandwidth limited.

clbrmbr 1y ago

At $200/month the comparable should be Opus 4 not Sonnet 4.

rowanG077 1y ago
Not really. With Opus 4 you will burn into the thousand a month with serious usage. I tested it yesterday and 5 hours of use was 60$. If I extrapolate that you will easily hit 1K+.
- lordofgibbons 1y ago
  Are you comparing using opus via API based usage vs opus via the $200/mo plan?
  - rowanG077 1y ago
    I didn't know anthropic offered a fixed price version.

unshavedyak 1y ago

Super curious to see some comparisons to claude code. Especially Opus, since they're primarily comparing it to Sonnet in that graph.

dpkirchner 1y ago

For those that have tried this, what kind of time-to-first-token latency are you seeing?

txyx303 1y ago
feels very low compared to claude/gpt for me
anonym29 1y ago
I had 9 seconds, earlier with Cline. That said, resulting output file I had requested generation of was over 122KB in 58.690 seconds, so I was approaching 2KB per second even factoring in high TTFT.
M4v3R 1y ago
The high TTFT (around 5-6 seconds) is what kills the excitement for this for me. Sure, when it starts outputting its crazy fast so it’s good for generating single file prototypes, but as soon as you try to use it in Cline or any other agentic loop you’ll be waiting for API requests constantly and it’s a real bottleneck.
- hollerith 1y ago
  TTFT == time to first token. (I would've just said, "the throughput is fantastic, but the latency is about 3 times higher than other offerings".)

crawshaw 1y ago

If you would like to try this in a coding agent (we find the qwen3-coder model works really well in agents!), we have been experimenting with Cerebras Code in Sketch. We just pushed support, so you can run it with the latest version, 0.0.33: brew install boldsoftware/tap/sketch CEREBRAS_API_KEY=... sketch --model=qwen3-coder-cerebras -skaband-addr= Our experience is it seems overloaded right now, to the point where we have better results with our usual hosted version: sketch --model=qwen

lvl155 1y ago

Their hardware is incredible. Why aren’t more investors lining up for this in this environment?

dmitrygr 1y ago
Contradictions do not exist. Whenever you think that you are facing a contradiction, check your premises. You will find that one of them is wrong.
- deleted 1y ago
  [deleted]
- thfuran 1y ago
  Neither do perfectly efficient, perfectly rational markets.
  - sejje 1y ago
    A perfectly efficient market would be a bad premise, sure.
- orbifold 1y ago
  In this case the hardware is a nightmare to program.
  - dmitrygr 1y ago
    Bingo
- arisAlexis 1y ago
  Or just bad marketing vs the Goliath (Nvidia)
- Invictus0 1y ago
  Kurt Gödel would like a word
1y ago

lxe 1y ago

Is this available as cline/roo-code integration? I think it might be on openrouter too.

d3vr 1y ago
Cline support added in v3.20.4: https://github.com/cline/cline/releases/tag/v3.20.4 https://github.com/cline/cline/releases/tag/v3.20.4 Roo Code support added in v3.25.5: https://github.com/RooCodeInc/Roo-Code/releases/tag/v3.25.5 https://github.com/RooCodeInc/Roo-Code/releases/tag/v3.25.5 Cerebras has also been added as a provider for Qwen 3 Coder in OpenRouter: https://openrouter.ai/qwen/qwen3-coder?sort=throughput https://openrouter.ai/qwen/qwen3-coder?sort=throughput
- d3vr 1y ago
  BTW you can also go through HuggingFace: https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct?inference_provider=cerebras https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct?i...

scosman 1y ago

Groq also probably has this in the works. Fun times.

Consumer-Basics 1y ago
Verified or just a thought?

Flux159 1y ago

Tried this out with Cline using my own API key (Cerebras is also available as a provider for Qwen3 Coder via via openrouter here: https://openrouter.ai/qwen/qwen3-coder https://openrouter.ai/qwen/qwen3-coder) and realized that without caching, this becomes very expensive very quickly. Specifically, after each new tool call, you're sending the entire previous message history as input tokens - which are priced at $2/1M via the API just like output tokens. The quality is also not quite what Claude Code gave me, but the speed is definitely way faster. If Cerebras supported caching & reduced token pricing for using the cache I think I would run this more, but right now it's too expensive per agent run.

Havoc 1y ago
This seems to be rate limited by message not token so the lack of cache may matter less
- deleted 1y ago
  [deleted]
- Flux159 1y ago
  The lack of caching causes the price to increase for each message or tool call in a chat because you need to send the entire history back after every tool call. Because there isn’t any discount for cached tokens you’re looking at very expensive chat threads.
- NitpickLawyer 1y ago
  Yes, but the new "thing" now is "agentic" where the driver is "tool use". So at every point where the LLM decides to make a tool use, there is a new request that gets sent. So a simple task where the model needs to edit one function down the tree, there might be 10 calls - 1st with the task, 2-5 for "read_file", then the model starts writing code, 6-7 trying to run the code, 8 fixing something, and so on...
  - itsafarqueue 1y ago
    Yup. If you’ve ever watched a 60+ minute agent loop spawning sub agents, your “one message” prompt leaves you several hundred messages in the hole.

cellis 1y ago

What are the token prices?

anonym29 1y ago
$2/Mtok in and out but no caching discounts

deevus 1y ago

I'm finding myself switching between subscriptions to ChatGPT, T3 Chat, DeepSeek, Claude Code etc. Their subscription models aren't compatible with making it easy to take your data with you. I wish I could try this out and import all my data.

atkailash 1y ago

I use regular cerebras for plan stage in cline, so I’m very excited to try this out

attentive 1y ago

Attn: Cerebras Any attempt to deal with "<think>" in the code gets it replaced with "<tool_call>". Both in inference.cerebras.ai chat and API. Same model on chat.qwen.ai doesn't do it.

unraveller 1y ago

Some users who signed up for pro ($50 p.m.) are reporting further limitations than those advertised. >While they advertise a 1,000-request limit, the actual daily constraint is a 7.5 million-token limit. [1] Assumes an average of 7.5k/request whereas in their marketing videos they show API requests ballooning by ~24k per request. Still lower than the API price. [1] https://old.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebras_pro_coder_deceptive_limits/ https://old.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebra...

itsafarqueue 1y ago
Bait and switched their FAQ after the fact too. Come on Cerebras, it’s only VC money you’re burning here in the first place, let’s see some commitment to winning market share. :money: :fire:
apwell23 1y ago
shocking..
nickandbro 1y ago
Had a similar experience. I got rate limited as well even when I well below 1M tokens. When its working, it's nice, but can't use it as a replacement for Cursor until higher rate limits are granted.

esafak 1y ago

They should just host all the latest open source models FTW.

hexagrams64 1y ago

[dead]

segmondy 1y ago

FYI, you are probably going to use up your tokens because there's a total limit of tokens per day, so in about 300 requests it's feasible to use it all up. See https://www.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebras_pro_coder_deceptive_limits/ https://www.reddit.com/r/LocalLLaMA/comments/1mfeazc/cerebra...

exclipy 1y ago

Windsurf also has Cerebras/Qwen3-Coder. 1000 user messages per month for $15 https://x.com/windsurf/status/1951340259192742063 https://x.com/windsurf/status/1951340259192742063

bluelightning2k 1y ago
This is awesome. I still use windsurf and like it. Their tab model is really good

evrennetwork 1y ago

[dead]

another_twist 1y ago

How does context buildup work for the code generating machines generally ? Do the programs just use human notes + current code directly ? Are there some specific ranking steps that need to be done ?

jedisct1 1y ago

I'm a little bit confused. I subscribed to the $50 plan. It's super fast for sure, but rate limits kick in after just a couple requests. completely defeating the fact that responses are fast. Did I miss something?

TacticalCoder 1y ago
[dead]

saberience 1y ago

Ok it's fast, but rate limits seem to kick in extremely quickly and the results are less good than Claude Code and it ends up more expensive? Who is the intended audience for Cerebras?

ritenuto 1y ago
While I’m also curious, I’m fine with having a mostly inferior alternative too. This is a dynamic market with some big players already; having more options is beneficial. If only as a way to prevent others from doing a rug pull.

ixel 1y ago

The usage limit on Cerebras Code is rather limited, $50 plan apparently gives you 7.5 million tokens per day which doesn't last long. This also isn't clearly advertised on the plans prior to purchasing.

d3vr 1y ago
Yeah really disappointing, hopefully they'll reconsider this limit because it really isn't usable, especially with "agentic tools" (e.g: opencode) ..

romanovcode 1y ago

> and no weekly limits! No weekly limits so far. Just you wait if you get same or more traction as Claude you are going to go same playbook as they did.

scosman 1y ago

Anyone get this working in Cursor? I can connect openrouter just fine, but Cerebras just errors out instantly. Same url/key works via curl, so some sort of Cerebras/Cursor compatibility issue.

dlojudice 1y ago
Same here. Got this msg on the Celebras discord: > Yeah I filed a ticket with Cursor > They have problems with OpenAI customization

hereme888 1y ago

So for <$1.7/day I can hire a programmer at a sort-of Claude Sonnet 4 level? I know it's got its quirks, limits, and needs supervision, but it's like 20x cheaper than an average programmer.

tbarbugli 1y ago
ofc it depends where you would hire, for me (NL) its above 100x more efficient

rbitar 1y ago

This token throughput is incredible and going to set a new bar in the industry. The main issue with the cerebras code plan is that number of requests/minute is throttled, and with agentic coding systems each tool call is treated as new "message" so you can easily hit the api limits (10 messages/minute). One workaround we're doing now that seems to work is use claude for all tasks but delegate specific tools with cerebras/qwen-3-coder-480b model to generate files or other token heavy tasks to avoid spiking the total number of requests. This has cost and latency consequences (and adds complexity to the code), but until those throttle limits are lifted seems to be a good combo. I also find that claude has better quality with tool selection when the number of tools required is > 15 which our current setup has.

deleted 1y ago
[deleted]