Description

In this role, you will lead a dynamic team to develop and deploy cutting-edge AI solutions, balancing technical tasks with team management. Your work will involve integrating advanced AI features into products and ensuring their reliable performance across various devices.

Requirements

• •Excellent programming skills in C++
• •Strong experience with Llama.cpp and ggml inference engines
• •Good understanding of deep learning concepts and model architectures
• •Experience with transformers and LLMs
• •Demonstrated ability to rapidly assimilate new technologies and techniques
• •Experience managing a small, specialized, cross-functional team
• •Genuine passion for building good products
• •Degree in Computer Science, AI, Machine Learning, or related field
• •Extensive experience with Javascript/Typescript
• •Experience with AWS, containerization platforms, orchestration, and automated testing suites
• •Understanding of p2p technology
• •Experience with MLC, TVM or similar frameworks
• •Experience with Vulkan, CUDA
• •Experience productionizing models

Tasks

• •Lead a cross-functional team in AI development
• •Ensure reliable performance of local AI capabilities across devices
• •Balance hands-on technical work with team coordination
• •Deploy machine learning models to edge devices using frameworks like llama.cpp, ggml, and onnx
• •Collaborate with researchers to code, train, and transition models to production
• •Integrate AI features into existing products with the latest machine learning advancements
• •Manage a team of middleware, foundation, QA, and documentation engineers
• •Assess market position qualitatively and quantitatively against similar products
• •Leverage technical architects' expertise for robust architectural choices
• •Ensure stable releases by following internal release processes

Tools & Technologies