Description

In this role, you will focus on optimizing AI inference engines for edge devices, collaborating with researchers to transition models into production, and enhancing existing products with cutting-edge machine learning features.

Requirements

• •Excellent programming skills in C++
• •Experience in Javascript
• •Strong experience with Llama.cpp and ggml inference engines
• •Good understanding of deep learning concepts and model architectures
• •Experience with transformers and LLMs
• •Demonstrated ability to rapidly assimilate new technologies and techniques
• •Degree in Computer Science, AI, Machine Learning, or related field
• •Solid track record in AI R&D

Tasks

• •Work on the C++ layer for local AI
• •Port and enhance inference engines like llama.cpp and ONNX
• •Optimize models for faster loading and leaner performance
• •Ensure stability and optimization of the inference layer
• •Deploy machine learning models to edge devices
• •Collaborate with researchers on coding and training models
• •Transition models from research to production environments
• •Integrate AI features into existing products

Tools & Technologies