full-timeCyprus, SerbiaToday
Python Inference Engineer
Gcore
Salary not specified
See jobs picked for you, not just this one
Take the 3 minute quiz and get matched with remote roles based on your timezone, skills, and async needs.
Get matched →machine-learning-engineeringpython-engineeringai-infrastructure-engineeringbackend-engineeringplatform-engineeringsenior-ai-inference-engineerllm-inference-specialistsenior-python-engineer
About this role
What You’ll Do • Build and improve the inference layer of the Gcore Inference platform. • Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM. • Bring new language and multimodal models into production. • Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency. • Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.…