Implemented RAG System with n8n and Supabase
- Day: 2025-01-30
- Time: 14:10 to 17:45
- Project: Dev
- Workspace: WP 2: Operational
- Status: Completed
- Priority: MEDIUM
- Assignee: Matías Nehuen Iglesias
- Tags: N8N, RAG, Supabase, Workflow, Vectorization
Description
Session Goal
The session aimed to develop a Retrieval-Augmented Generation (RAG) system using n8n and Supabase, focusing on workflow setup, document processing, and vectorization.
Key Activities
- Set up the RAG system workflow using n8n and integrated it with Supabase for document processing.
- Developed a SQL function for similarity-based document retrieval using vector embeddings.
- Evaluated the use of n8n versus Python for chunkization and vector storage.
- Implemented dynamic vectorstore management, enabling on-the-fly updates without restarting the application.
- Enhanced the UI for directory selection, including checkbox features for multi-directory processing.
- Resolved technical issues with Chroma’s
persist()in LangChain. - Migrated to a better storage structure for RAG processing.
Achievements
- Successfully integrated n8n with Supabase for a functional RAG system.
- Created a robust document retrieval function using vector embeddings.
- Improved UI/UX for directory management and processing.
Pending Tasks
- Further evaluate the performance implications of using n8n versus Python for specific tasks.
- Continue refining the RAG app’s architecture for better performance and usability.
Evidence
- source_file=2025-01-30.sessions.jsonl, line_number=1, event_count=0, session_id=e0c40ccc211370e42fd1ff736dfcb5c5e6c96434fdfe8819b8cae9ff7c5aa2e3
- event_ids: []