Working demo - Watch videoclone this repository to work in localbug report? feel free to create an issueRequirements to run this on local machine<ul><li>Python - for backend</li><li>Ollama - to use LLM on Local</li><li>Docker - to run Qdrant storage</li><li>Nodejs - for frontend &amp; backend</li><li>Qdrant Docker Image</li></ul>Run this command to run docker image<pre><code>docker run -p 6333:6333 -p 6334:6334 \
 -v $(pwd)/qdrant_storage:/qdrant/storage:z \
 qdrant/qdrant
</code></pre>Backend Setuppull llm from ollama<pre><code>ollama pull gemma:2b
ollama pull nomic-embed-text
</code></pre>run ollama<pre><code>ollama serve
</code></pre>PYTHON BACKEND<blockquote>Note:- website module is in development</blockquote>Install dependencies<pre><code>pip install pypdf qdrant_client sentence_transformers langchain_community langchain
</code></pre>run backend<pre><code>python cool_api
</code></pre>NODEJS BACKENDInstall dependencies<pre><code>pnpm install
</code></pre>run backend<pre><code>pnpm dev
</code></pre>backend should be running on http://localhost:3009. open http://localhost:3009 in browser &amp; you should get this result<pre><code>{
 "data": "server says : get request on time : 11:39:49"
}
</code></pre>now your backend is ready!Package version used in python<ol><li>PyPDF2 - v3.0.1</li><li>qdrant-client - v1.7.3</li><li>sentence_transformers - v2.2.2</li><li>langchain_community - v0.0.21</li><li>langchain - v0.1.8<blockquote>If there is braking changes in newer version make sure to match the version</blockquote></li></ol>Frontend Setupinstall dependencies &amp; run the app<blockquote>website module not ready for frontend</blockquote><pre><code>cd frontend
pnpm install
pnpm dev
</code></pre>Give it star ⭐️Thank you

This documentation describe how you can create a RAG app to intereract with a PDF document

PDF Rag App - Ollama, Qdrant & Langchain documentation