Member-only story
Using WSL for AI App Development
If you are not Medium member or have exceeded your free quota, you can read this story by clicking on this link https://rkanade.medium.com/2e2dcd3da033?source=friends_link&sk=a6b5726e0414ab78ba382ccbacd31fcd
Linux is an open-source, Unix-like operating system kernel created by Linus Torvalds in 1991. It was inspired by Unix but developed as a free and open alternative. Today, Linux powers servers, cloud infrastructure, Android devices, IoT, cybersecurity, DevOps, and AI research.
Recently we have started working on a research project with a high level requirements as under:
✅ Crawls public websites for topics of your interest ( e.g. Java ).
✅ Extracts potential Java questions and generates high-quality answers consulting multiple LLMs.
✅ Uses LLMs (Large Language Models) for Q&A generation, topic classification, and logical error analysis.
✅ Runs a scheduled batch inference processing system for efficiency.
✅ Uses PostgreSQL for structured data storage and LLMs for semantic search.
✅ Optimizes inference performance on a local Linux environment using WSL and SSD-based swap.
✅ Implements benchmarking & auto-routing for cost-effective LLM selection (local hosted models and cloud hosted like Groq, GPT-4).