6 ms·
Hugging Face does maintain a package named Text Embedding Inference (TEI) with GPU/CPU-optimized container images. While I have only used this for hosting embed
by pilotneko 2y ago
Hugging Face does maintain a package named Text Embedding Inference (TEI) with GPU/CPU-optimized container images. While I have only used this for hosting embedding models, it does appear to support Roberta architecture classifiers (specifically sentiment analysis).
https://github.com/huggingface/text-embeddings-inference https://github.com/huggingface/text-embeddings-inference
You can always run a zero shot pipeline in HF with a simple Flask/FastAPI application.
- backend-dev-33 2y agothanks for Text Embedding Inference (never heard about it before) > you can always run a zero shot pipeline in HF with a simple Flask/FastAPI application. Yeah, sometimes things that are right in front of your nose, you don't see them. you mean this? https://huggingface.co/docs/api-inference/index https://huggingface.co/docs/api-inference/index
- pilotneko 2y agoSorry, life got busy and I haven’t been able to get back to you. I was referring to pipelines in the Transformers package from Hugging Face. https://huggingface.co/docs/transformers/v4.45.2/en/main_classes/pipelines#transformers.pipeline https://huggingface.co/docs/transformers/v4.45.2/en/main_cla... These are essentially function calls for you to run pre-trained models. If you want to continue this conversation elsewhere, feel free to shoot me an e-mail. It’s just my username @ gmail.