🔀Smart Router

The Smart Router is an innovative feature of Catena Lab's forthcoming platform and services for other AI and web3 builders. The Smart Router is engineered to direct your messages to the most suitable AI model. It considers a variety of factors to make these routing decisions and gets smarter with use.

Purpose-Built for Versatility

As AI capabilities expand and become increasingly specialized, we've recognized the need for a tool that harnesses the collective power of diverse models. The Smart Router embodies our belief in a multi-model approach, which allows users to benefit from the strengths of various AI providers. The result? Enhanced quality, performance, and cost-effectiveness in the solutions we deliver.

How DecentAI Uses the Smart Router

DecentAI is the first experimental application to integrate the Smart Router. Here’s how it functions:

• Intent: The router assesses intent and complexity by leveraging a combination of specialty LLMs and semantic search analysis.

• Model history, health, and economics: Previous response evaluations, current response time and health monitoring, rate limits and cost are factored into routing decisions.

• Preferences: Whether user priority is using open-source models, speed of response, or quality of output, the Smart Router adjusts its routing accordingly.

• Cache: The router may return replies from an organic semantic cache for speed optimizations.

• Future Capabilities:The Smart Router will evolve to consider additional criteria and evaluations to refine its model, tool, and service selection process.

Considerations for Open Source Preferences

Choosing "open source only" in DecentAI settings tailors AI interactions to only use open-source models.

Routing for Image Generation

The Smart Router also routes to image models:

• Model Selection: If "all models" is chosen, the router considers all available options for image generation, selecting the best fit based on the complexity of your request.

• Tailored Responses: For more complex image requests, the Smart Router evaluates the capabilities of each model to ensure your creative vision is realized with clarity and precision.

The Smart Router is a testament to our commitment to offering you a nuanced, customizable AI experience. It's about giving you the freedom to choose and the power to discover – all through the convenience of DecentAI.