alandu

7 ms·

1.
by alandu 2y ago
An example question in that eval set is "How many publications were published between 2019 and 2021?". That's something GPT without any context can understand how to answer from a schema (which I assume has a column called pu
2.
by alandu 2y ago
The bottleneck was mostly in writing the SQL query, which took a lot of time due to the messiness/complexity of the data
3.
by alandu 2y ago
Thanks we will rethink how the product is presented on our website!
4.
by alandu 2y ago
Right, we are not open source, but the IDE is free to use. The Slack integration and other product offerings that are in the works will be in the 'premium' version of the product that's sold to enterprise
5.
by alandu 2y ago
There are other product additions in the works, like hooking it up to your locally opened Slack. The plugin would be limiting
6.
by alandu 2y ago
If you open a .sql file into the workspace, the queries in that file will be auto parsed and used as context for Q&A. If you're willing, would love to help debug - could you email support@dalmatian.ai
7.
by alandu 2y ago
We have not come across any benchmark dataset that's actually worth evaluating on because the questions are not representative of real world enterprise problems. They don't reflect the degree of context needed to answer domain&#x2
8.
by alandu 2y ago
I used to get slammed with so many requests that my boss had to tell the sales team to reduce the number of questions and only ask highest priority ones. Analytics teams serve a lot of different teams in an org, and the requests can really
9.
by alandu 2y ago
1 - yes our current solution does require you to be allowed to use ChatGPT/OpenAI. Unfortunately the accuracy using smaller models (even GPT-3.5) is poor. We don't see a local model (which will be much worse than GPT-3.5) even wit
10.
by alandu 2y ago
Just want to clarify that OpenAI does not train on the query code and schema info we send via API. It's equivalent to using https://chat.openai.com/ setting "Improve the model for everyone" (previously "
11.
Show HN: DaLMatian – Text2sql that works(dalmatian.ai)
44 points by alandu 2y ago|28 comments