Supercharging Financial Insights with RAG-Based Search on Microsoft SQL Server

This RAG-LLM solution helps financial research teams, portfolio managers, and strategy analysts surface timely, actionable market intelligence by combining semantic search on Microsoft SQL Server with Hugging Face models and GPU-accelerated inference on Red Hat OpenShift on Azure — delivering relevant answers with source citations.

Overview
RAG-based search with Microsoft SQL Server

This validated pattern demonstrates how to deploy a Retrieval-Augmented Generation (RAG) architecture using open-source Large Language Models (LLMs) on Red Hat OpenShift in Microsoft Azure, with Microsoft SQL Server (Azure SQL) as the integrated vector store and structured data source. 


Combining the scalability of OpenShift, the compliance and manageability of Azure, and the familiarity of Azure SQL, this pattern enables enterprises to build production-ready AI solutions for knowledge discovery, data research and intelligent automation.

Scalable Market Data Processing

Store public earnings reports, investor presentations, analyst notes, and licensed market research in Azure SQL. Use open-source LLMs on OpenShift to process and summarize vast volumes of unstructured data with semantic search and grounded answers.

GitOps Automation for AI Workflows

Deploy and manage the entire AI pipeline — from vector indexing to LLM inference — using declarative GitOps workflows with Red Hat OpenShift. Ensure consistent, reproducible deployments across environments.

Hybrid Retrieval for Better Context

Combine vector similarity search with structured market or economic data stored in Azure SQL to generate contextual, explainable answers for research questions like trend comparisons or historical performance.

Explainable, Source-Linked Answers

Empower research teams to quickly draft reports, generate competitive comparisons, or create briefing notes, backed by references to original documents for transparency.

Accelerated Time-to-Insigh

 Empower analysts and research teams to surface critical market signals and trends faster by combining real-time vector search with trusted data sources — freeing up time for deeper analysis and higher-value recommendations.

Get started with OpenShift

A container platform to build, modernize, and deploy applications at scale.

Try itDeployment options
ResourcesFAQs

What are the prerequisites to get started?

Before deploying, you should have an Azure subscription with permissions to deploy ARO and Azure SQL. Access to Red Hat OpenShift clusters (self-managed or Azure-managed) will also be needed, along with familiarity with GitOps workflows (the pattern provides example repositories) and a basic understanding of LLM container images and vector embedding workflows.

What is this validated pattern for?

This pattern demonstrates how to deploy a Retrieval-Augmented Generation (RAG) pipeline using open-source Large Language Models (LLMs) on Red Hat OpenShift with Microsoft Azure and Azure SQL. It shows how to combine structured data, unstructured content, and vector search in Azure SQL to deliver grounded, explainable AI answers.

How do I deploy this pattern?

You can deploy the entire stack using GitOps. After you clone the provided validated pattern GitHub repo, set up your Azure resources (ARO, Azure SQL etc - along with your preferred GPU node). Then you can install the pattern via the Validated Patterns operator. Finally, you can validate your pipeline using the example data and test prompts.

What Azure services are required?

Azure Red Hat OpenShift (ARO) can be used to to run containerized LLM workloads at scale. Note that ARO is not a hard requirement. You can use OpenShift on Azure outside of ARO with Azure SQL as well as other cloud providers with Azure SQL. Microsoft SQL Server (Azure SQL) is used to store structured data and vector embeddings for RAG retrieval and a GitOps tools (like ArgoCD) can be used for automated deployment and operations. Optional integrations include Azure AI services, Key Vault, and other Azure-native security and networking tools.
Red Hat logoLinkedInYouTubeFacebookTwitter

Platforms

Products & services

Try, buy, sell

Help

About Red Hat Ecosystem Catalog

The Red Hat Ecosystem Catalog is the official source for discovering and learning more about the Red Hat Ecosystem of both Red Hat and certified third-party products and services.

We’re the world’s leading provider of enterprise open source solutions—including Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.

© 2025 Red Hat