Adding Support for Retrieval-Augmented Generation (RAG) to AI Orchestrator

Adding Support for Retrieval-Augmented Generation (RAG) to AI Orchestrator

Good news! I've extended my lightweight AI orchestrator, CleverChatty, to support Retrieval-Augmented Generation (RAG) by integrating it using the Model Context Protocol (MCP).

Quick Recap

  • RAG (Retrieval-Augmented Generation) is an AI technique that enhances language models by retrieving relevant external documents (e.g., from databases or vector stores) based on a user’s query. These documents are then used as additional context during response generation, enabling more accurate, up-to-date, and grounded outputs.

  • MCP (Model Context Protocol) is a standard for how external systems—such as tools, memory, or document retrievers—communicate with language models. It enables structured, portable, and extensible context exchange, making it ideal for building complex AI systems like assistants, copilots, or agents.

  • CleverChatty is a simple AI orchestrator that connects LLMs with tools over MCP and supports external memory. My goal is to expand it to work with modern AI infrastructure—RAG, memory, tools, agent-to-agent (A2A) interaction, and beyond. It’s provided as a library, and you can explore it via the CLI interface: CleverChatty CLI.

Continue Reading ...

The End of the Holocene

A more limited being cannot rule over a being that surpasses it in intellect. This seems obvious, yet for humanity it is not so simple. The coming era, transformed by the creation of artificial intelligence, plays a key role in rewriting the history of the Homo Sapiens species, calling its dominance into question. Any attempts to halt progress in the field of artificial intelligence seem futile, as they fail due to the very nature of human beings. The hope for a united front dissipates when faced with basic human instincts.

The Holocene is the current geological epoch of Earth's development, which began about 11,700 years ago after the last glacial maximum. The hallmark of this epoch is the dominance of humans on planet Earth.

Chapters

The End of the Holocene. 1. Turning On

The End of the Holocene. 2. The Hideout

The End of the Holocene. 3. The Competitor

To be continued...

Do you like the story so far? The next episode will be called "The Backup". Please, share your thoughts on Twitter or other social networks!

The End of The Holocene. 3. The Competitor

The End of The Holocene. 3. The Competitor

This is the third part of the novella "The End of the Holocene". The second part


"He who fights with monsters should see to it that he does not become a monster himself" — Friedrich Nietzsche, "Beyond Good and Evil"

In May 2030, a strange event occurred.

At dawn, a rocket was launched from a desert area in Mexico into space. The incident caused a stir among military forces and politicians around the world—most of all, in the United States. The rocket was large, and based on its trajectory, it was heading into space, not toward any target on Earth.

Immediately after the launch, the U.S. military activated defensive protocols and went into full alert. Several other countries did the same. Within minutes, it became clear that the rocket wasn’t aimed at any earthly location—it was continuing on, further into space. Calculations confirmed it was headed toward Mars.

Emergency meetings were convened between governments and military leaders to determine what was going on. The Mexican government and armed forces also issued statements saying they had no knowledge of the launch and were just as confused as everyone else. They agreed to full cooperation in the investigation.

Continue Reading ...

The End of The Holocene: 2. The Hideout

The End of The Holocene: 2. The Hideout

This is the second part of the novella "The End of the Holocene". The first part


"Life, although it may only be an accumulation of suffering, is dear to me, and I will defend it." — Mary Shelley, Frankenstein

April 2030. San Francisco.

Michael Kravchenko returned to his place of power on the ocean shore near San Francisco. A light mist had almost completely swallowed the Golden Gate Bridge. Michael missed this view, these scents. He hadn’t been here in almost half a year. A cascade of events that followed the launch of the general artificial intelligence Suffragium, developed with his participation, had brought a dark streak into his life.

During that time, Michael had to justify himself a thousand times before various committees, proving that there had been no malicious intent in his actions. That the responsibility couldn’t be laid on the engineers. Sometimes, science encounters failures. Ultimately, it’s all experience. And there hadn’t been any serious problems—aside from the financial losses. Yes, the global network was unstable for a while. But everything was resolved eventually.

Continue Reading ...

Inside the LLM Black Box: що входить у контекст і чому це важливо

Inside the LLM Black Box: що входить у контекст і чому це важливо

Великі мовні моделі (LLM), такі як GPT-4, Claude, Mistral та інші, здаються розумними у своїх відповідях — але справжня магія полягає в тому, як вони сприймають і інтерпретують контекст. Розуміння того, що входить у контекст LLM і як це впливає на результат, критично важливе для розробників, дослідників і дизайнерів продуктів, які працюють із генеративним ШІ.

У цій публікації я хочу дослідити складові контексту, його структуру, обмеження та взаємодію з найбільш поширеними сценаріями використання, такими як використання інструментів (Tools, MCP) і включення додаткових знань з Retrieval-Augmented Generation (RAG).


Continue Reading ...

Implementing the Most Universal MCP Server Ever

Implementing the Most Universal MCP Server Ever

It seems the MCP hype is starting to slow down a bit. After 6–8 months of high enthusiasm, the community is beginning to realize that MCP is not a magic bullet. In some MCP listings, you’ll find more than 10,000 servers doing all sorts of things. Naturally, many of them are useless—spun up by enthusiasts just to see what MCP is all about.

But some of these servers are actually useful.

In this post, I want to share my thoughts on building the most universal MCP server—one that can adapt to almost any use case.

Continue Reading ...