nmachado

7 ms·

1.
by nmachado 3y ago
We actually leverage LLMs very sparingly. We do not generate the transformed data directly as this would not just introduce significant latency, but also quality and reliability issues. Rather, we use LLMs to produce high-level mapping&#x2F
2.
by nmachado 3y ago
We haven't had bandwidth to run it on this example yet, but will report back when we do!
3.
by nmachado 3y ago
Sounds very useful, thank you for sharing.
4.
by nmachado 3y ago
Customers can use Lume to do one-off mappings along with recurring mappings. As seen in the demo video, you can create a mapping between any source and target schema. So, the workflow of using Lume is the same for both one-off and recurring
5.
by nmachado 3y ago
Our customers have a recurring need to map data and use those mappings, such as onboarding client, normalizing data from multiple systems, or build and maintain data pipelines. All of them have the common denominator of continually having t
6.
by nmachado 3y ago
Thank you!
7.
by nmachado 3y ago
wow! It's a pleasure, qarl :) Reach out anytime.
8.
by nmachado 3y ago
They are written in python but SQL is in the roadmap.
9.
by nmachado 3y ago
Great question. We focus on embedding in your data pipelines themselves. So, our AI automatically maps data, and can be used as a data pipeline indefinitely. Indeed, it can connect to APIs and handle dynamic output or edge cases you did not
10.
by nmachado 3y ago
Thank you for shouting this out! I'll look into getting a smaller version in there.
11.
Show HN: Lume – automate data mappings using AI(lume.ai)
76 points by nmachado 3y ago|26 comments
12.
by nmachado 3y ago
Right Lume is a low to no code tool (see demo), but we have gotten requests for an SDK. Creating a library / SDK is in our radar! If anyone has personal or company use cases for a library / SDK, please email founders@lume.ai, we&#
13.
by nmachado 3y ago
Gotcha! In that case, we do not yet support an end-to-end experience for this, but would be willing to prioritize building it for clients if we get strong demand.
14.
by nmachado 3y ago
This would be a concern if we are feeding the raw user input and feed it directly into an LLM. In our case, we are not simply a wrapper over an LLM. There are multiple parsing and rule-based steps done to the input schemas - we extract spec
15.
by nmachado 3y ago
Another user asked this about other IPaaS’, such as Workato. This is our response: https://news.ycombinator.com/item?id=35238714 In short, Lume can be used for the same use cases as Zapier. However, Zapier focuses on and su
16.
by nmachado 3y ago
Our V1 supports json and csv formats for manual imports, and we’re quickly expanding to other formats (like pdf). So, to clarify - Lume supports this today only if you provide the linked claim data in json or csv format, and in the near fut
17.
by nmachado 3y ago
If you have the desired standardized claim format, Lume supports this use case. We also have a pdf parser in the roadmap to parse documents exactly like the one you linked, to then transform and pipe the data accordingly.
18.
by nmachado 3y ago
Thanks! It is a funny meta moment to be using a similarly-named tool.
19.
by nmachado 3y ago
Yep - we do not expose any sort of prompting. We use the LLM only at specific parts of the process, and the user has no access to it.
20.
by nmachado 3y ago
Regarding guarantee that it will work correctly, there are ways to reduce the ambiguity in the task given. One way is to input very detailed descriptions of your end schema. This limits the amount of assumptions our model has to make. In ad
21.
by nmachado 3y ago
Yes, we are using an LLM for some parts of the code generation, specifically GPT-4. In the medium-term, we plan to go lower in the stack and have our own AI model. We broke down the process into modular steps to only leverage LLMs where it&
22.
by nmachado 3y ago
We leveraged Airbyte - it makes supporting that many connections much more seamless ... and a lot of coding!
23.
Launch HN: Lume (YC W23) – Generate custom data integrations with AI
115 points by nmachado 3y ago|56 comments