10 ms·
Ask HN: What things might help me to become inference engineer?
I used to work as a full-stack engineer, but it started to burn me out, and I lost interest in building SaaS products. Instead, I began looking for areas that would challenge me, which led me to Infrastructure Engineering. Specifically, I chose the Inference field because I want to remain relevant in the age of AI. I would appreciate advice from AI Infra engineers or anyone with relevant experience on how I can become a strong Inference engineer
- vikrant-gg 2mo agoIam also learning on a similar path. I do Applied Engineering work; now trying to learn inference optimization, Been reading - https://www.baseten.co/inference-engineering/ https://www.baseten.co/inference-engineering/ and I watched this course; it's really, really good - https://learn.deeplearning.ai/courses/fast-and-efficient-llm-inference-with-vllm/lesson/rm60gb/introduction https://learn.deeplearning.ai/courses/fast-and-efficient-llm...
- lemonademan 3mo agoAI inference infrastructure is a solid direction. I don't know much about this field, but I believe building strong systems, distributed computing, and GPU optimization skills will put you in a great position. I hope this could be of help.
- StreamCtx 3mo agoBeyond learning inference optimization, I’d also spend time understanding context management, memory systems, caching, and agent orchestration. Those seem to be becoming important building blocks for production AI systems.
- chalshik 3mo agonoted
- coalstartprob 3mo ago[dead]