Backend Software Developer - AI Integrations (RAG)​

Kaleidocode is an exciting software development consultancy that is looking for an experienced software developer to help our team build reliable, high-performing AI systems. You will need to design and build Retrieval-Augmented Generation (RAG) systems that combine cutting-edge LLMs with scalable, production-ready retrieval architectures. You’ll develop RAG pipelines, expose them via APIs, and ensure reliability through automated testing and CI/CD pipelines.

Key Responsibilities
  • Develop and optimize RAG pipelines using vector databases (Solr, Pinecone, Weaviate, FAISS) and LLM APIs (OpenAI, Anthropic, Hugging Face).
  • Build and maintain RESTful APIs (FastAPI or Flask) to serve AI-powered retrieval and generation capabilities.
  • Implement robust testing, monitoring, and CI/CD pipelines for deployment and reliability.
  • Integrate with internal and external systems to deliver scalable, observable AI microservices.

This is an exciting opportunity to expand your skill set and work on exciting projects for a global client. You’ll be part of a forward-thinking, highly skilled team pushing the boundaries of applied AI. 

Requirements:
  • Proven 3 years’ back-end development experience in commercial projects
  • Advanced level of proficiency in Python
  • Preferably experience working with LLM APIs, RAG architectures, and vector search technologies.
  • Strong grasp of testing, Docker, CI/CD, and observability tools (e.g. Grafana, Prometheus, OpenTelemetry).

The ideal candidates would have:
  • Ability to work effectively as part of a team and independently  
  • Ability to work in a variety of client settings and in a team-oriented environment 
  • Passion for the software industry and a wide interest in technology 
  • Good communication skills 
  • ​Knowledge of Agile/Scrum methodologies. 
​
​We appreciate people with a creative approach to problem-solving and a passion to grow their skills. You will work alongside smart, focused colleagues who design, code and deploy meaningful software with modern tools and processes.  ​

Preferred Qualifications:
  • Degree or Diploma in IT or Computer Science 
Picture
We love meeting new people, ​lets get started!
Kaleidocode is an established premium consultancy, known by our clients around the globe as highly skilled software professionals who deliver and add value. 

Salary
Salary offered will be commensurate with level of skill and experience.

Location
Kaleidocode (Pty) Ltd is based in Durban, KZN, South Africa. Remote applications are welcome, but visits to our Durban offices or client sites may be required.​

Responses
If you have not received a response within 4 weeks please consider your application to have been unsuccessful.

Data Privacy
By applying for this position, you consent to providing Kaleidocode Pivot Pty Ltd and Kaleidocode Pty Ltd with your personal information. This information will be used for the purposes of your application for a position within our company, and will not be made available to any other parties without your prior consent. Should your application be successful, we may require further personal or special information which will be obtained with your consent. 
​
For queries
If you have any queries about this position or working with Kaleidocode email [email protected] 
KALEIDOCODE. COPYRIGHT 2025. ALL RIGHTS RESERVED.