5 ms·

Engineer on the team here. Some of the interesting challenges of doing ChatGPT for circuit design were: 1) How to communicate the circuit connections to ChatGP

by greg 3y ago

Engineer on the team here. Some of the interesting challenges of doing ChatGPT for circuit design were: 1) How to communicate the circuit connections to ChatGPT in the text prompt. We ended up just using the standard netlist format. Apparently it knows about netlists from its training data. It also knows about datasheets. 2) How to get the needed accuracy and precision for questions like "calculate the resistance needed between component A and B". For that, we adopted the popular langchain framework to integrate specific "tools" into the AI for specific recognizable problems.

ZephyrBlu 3y ago
I'm curious if you fine-tuned a GPT model with specific hardware-related examples. Based on the OpenAI docs it seems like a pain to get enough good prompt:response pairs for fine-tuning (A few hundred minimum).
joshuanapoli 3y ago
How do you deal with designs whose netlist or part list exceeds the context size limit?
- rock_hard 3y ago
  It’s indeed a challenge For many applications such as talking to pdfs you can use a vectors db like pinecone But that doesn’t work well for schematics because for of the interesting use cases you need access to the whole thing. Here is what’s been working for us 1. Extreme compression and summarization of the data we dynamically put in the context 2. Leverage the extreme amount of world knowledge the cutting edge models have
arcticbull 3y ago
Out of curiosity, I noticed in the video that it recommended for a voltage regulator either an LM7805 or an LM1117 - either a super inefficient 5V regulator that has no business in new designs, or a 1.2V low-dropout 800mA regulator that is probably not appropriate to the other components it recommended (i.e. an LM7805 -> LM1117 would be 36% efficient at best). It then also recommends a LiPo battery with a nominal 3.7V which obviously wouldn't be compatible with its LM7805 recommendation. It also recommends an ESP8266 which is a 3.3V part so neither of the recommended regulators, nor the battery alone, would be appropriate. Also, it recommends a 168MHz STM ARM micro - but it already has an ESP8266 with GPIO. I'm not sure what it's suggesting I build but it doesn't really sound like a working environmental radiation logger ;) How should I think about this?
- assimpleaspossi 3y ago
  I find comments similar to yours about ChatGPT all over the internet. I finally took the time to ask that some questions over the last few days. All the answers it gave were mundane and expected from any click bait web site you can find. I Googled the same questions and found similar answers. Some personal questions it refused to answer or give suggestions because "only you can decide" was the response. I'm very suspicious of all this. I'm thinking the only real benefit--some may say--is the chat aspect. You can carry on a conversation rather than having to determine a proper Google search over and over again. Which makes me think there is some hype involved.
  - gfodor 3y ago
    You’re probably not using GPT-4, the internet is being flooded with takes about GPT-3.5’s quality like this simply because the author doesn’t know there is a meaningful difference with the new model.
    - jacquesm 3y ago
      If GPT-X would just shut up if it doesn't know something it would already be 10x more useful than it is right now.
      - gedy 3y ago
        Isn't that the core issue? Its model doesn't really "know" what is real or made up.
    - assimpleaspossi 3y ago
      When I go here: https://openai.com/product/gpt-4 https://openai.com/product/gpt-4 it says "try on chatgpt plus" and sends me to the same page I log in with and that's where I've been testing it.
      - sbohacek 3y ago
        Be sure that you select GPT-4 from the drop down list of models. For each new chat, it reverts back to default GPT-3.5.
ugh123 3y ago
Do you do any fine tuning of the model for circuit analysis and other hardware design literature?

by greg 3y ago

ZephyrBlu 3y ago

I'm curious if you fine-tuned a GPT model with specific hardware-related examples. Based on the OpenAI docs it seems like a pain to get enough good prompt:response pairs for fine-tuning (A few hundred minimum).

joshuanapoli 3y ago

How do you deal with designs whose netlist or part list exceeds the context size limit?

rock_hard 3y ago
It’s indeed a challenge For many applications such as talking to pdfs you can use a vectors db like pinecone But that doesn’t work well for schematics because for of the interesting use cases you need access to the whole thing. Here is what’s been working for us 1. Extreme compression and summarization of the data we dynamically put in the context 2. Leverage the extreme amount of world knowledge the cutting edge models have

arcticbull 3y ago

Out of curiosity, I noticed in the video that it recommended for a voltage regulator either an LM7805 or an LM1117 - either a super inefficient 5V regulator that has no business in new designs, or a 1.2V low-dropout 800mA regulator that is probably not appropriate to the other components it recommended (i.e. an LM7805 -> LM1117 would be 36% efficient at best). It then also recommends a LiPo battery with a nominal 3.7V which obviously wouldn't be compatible with its LM7805 recommendation. It also recommends an ESP8266 which is a 3.3V part so neither of the recommended regulators, nor the battery alone, would be appropriate. Also, it recommends a 168MHz STM ARM micro - but it already has an ESP8266 with GPIO. I'm not sure what it's suggesting I build but it doesn't really sound like a working environmental radiation logger ;) How should I think about this?

assimpleaspossi 3y ago
I find comments similar to yours about ChatGPT all over the internet. I finally took the time to ask that some questions over the last few days. All the answers it gave were mundane and expected from any click bait web site you can find. I Googled the same questions and found similar answers. Some personal questions it refused to answer or give suggestions because "only you can decide" was the response. I'm very suspicious of all this. I'm thinking the only real benefit--some may say--is the chat aspect. You can carry on a conversation rather than having to determine a proper Google search over and over again. Which makes me think there is some hype involved.
- gfodor 3y ago
  You’re probably not using GPT-4, the internet is being flooded with takes about GPT-3.5’s quality like this simply because the author doesn’t know there is a meaningful difference with the new model.
  - jacquesm 3y ago
    If GPT-X would just shut up if it doesn't know something it would already be 10x more useful than it is right now.
    - gedy 3y ago
      Isn't that the core issue? Its model doesn't really "know" what is real or made up.
  - assimpleaspossi 3y ago
    When I go here: https://openai.com/product/gpt-4 https://openai.com/product/gpt-4 it says "try on chatgpt plus" and sends me to the same page I log in with and that's where I've been testing it.
    - sbohacek 3y ago
      Be sure that you select GPT-4 from the drop down list of models. For each new chat, it reverts back to default GPT-3.5.

ugh123 3y ago

Do you do any fine tuning of the model for circuit analysis and other hardware design literature?