Software Engineer

Key Responsibilities:

• Build products and MVPs on top of the models.
• Fine-tune the models for domain-specific use cases.
• Design evaluation pipelines and benchmarks for fine-tuned models.
• Build and maintain product backends and front-end interfaces to integrate and showcase models capabilities.
• Work with researchers and engineers to move models from lab to product.
• Translate product needs into model capabilities and technical requirements.
• Optimize model performance and user experience.
• Data Context Engineering: Connect foundation models to enterprise data sources using RAG (Retrieval-Augmented Generation) architectures and semantic search.
• Production API Design: Design clean, scalable, and high-throughput APIs that interface seamlessly between user-facing frontends and backend model runtimes.
• LLM Application Observability: Implement end-to-end tracing and monitoring to track application latency, prompt execution paths, and token/API costs.

Requirements:

• High-Performance Systems (Rust): Practical experience using Rust for performance-critical backend layers and data-parsing pipelines.
• AI Orchestration Frameworks: Hands-on experience with LLM data and orchestration frameworks such as LangChain, LlamaIndex, or similar tooling.
• Vector Databases: Familiarity with vector search engines and vector databases to manage unstructured data retrieval.
• LLM Observability Platforms: Familiarity with specialized application tracing and evaluation tools (e.g., Langfuse, LangSmith, Phoenix).Strong coding skills in Python and ML frameworks (PyTorch, TensorFlow, JAX, etc).
• Hands-on experience fine-tuning large models.
• Knowledge of LoRA, prompt tuning, RLHF or similar methods.
• Experience with cloud, GPU environment, Docker/Kubernetes, etc.
• Experience with backend development frameworks.
• Experience with frontend frameworks.
• Ability to quickly build prototypes and iterate.
• Good communication and teamwork.

Qualifications:

• Master's degree in Computer Science or a related field
• Strong experience in applied AI software development We do our best to respond to all applications. However, due to the high volume of applications we receive, we may not be able to respond to everyone individually.