13 ms·
I like it! Any plans to add Google Vertex AI support?
by koryk 3y ago
I like it! Any plans to add Google Vertex AI support?
- fatso784 3y agoThere is a long term vision of supporting fine-tuning through an existing evaluation flow. We originally created this because we were worried about how to evaluate ‘what changed’ between a fine-tuned LLM and its base model. I wonder if Vertex AI has an API that we could plug-in, though, or if it’s limited to the UI.
- koryk 3y agoI meant for completion, chat and embedding. https://cloud.google.com/vertex-ai/docs/generative-ai/chat/test-chat-prompts#chat-query-drest https://cloud.google.com/vertex-ai/docs/generative-ai/chat/t... . Some examples here. Vertex AI has the same API as PaLM as far as I know. However, the authorization is through Google Cloud. So I use it like any other GCP API. I love the idea of adding fine tuning as a node though. Here is the API for creating a model tuning job - https://cloud.google.com/vertex-ai/docs/generative-ai/models/tune-models https://cloud.google.com/vertex-ai/docs/generative-ai/models... I wish I could use ChainForge nodes in Node Red.