Job Description


Responsibilities Backend Development

● Lead the development efforts on the Nitro Inference Server in C++, maximizing its performance and functionality. 

● Drogon CPP framework experience is a big plus

● Apply your expertise in computer vision/ NLP and matrix manipulation using C++, creating robust and optimized solutions.

● Design and write efficient bindings from other languages to C++, similar to projects like Llama Rust and Llama C++ Python. Architecture and Planning

● Break down ambiguous goals and high level goals into a well architected, technical execution plan.

● Implement cost-effective solutions, innovates with rapid spikes, avoids “penny wise, pound foolish” trade offs.



Requirements

● Proven experience in C++ development.

● Solid understanding of gRPC and its applications in web server optimization.

● Experience in high-performance computing, particularly in ...