Member-only story

Using WSL for AI App Development

Rajesh Kanade
5 min read2 days ago

--

If you are not Medium member or have exceeded your free quota, you can read this story by clicking on this link https://rkanade.medium.com/2e2dcd3da033?source=friends_link&sk=a6b5726e0414ab78ba382ccbacd31fcd

Linux is an open-source, Unix-like operating system kernel created by Linus Torvalds in 1991. It was inspired by Unix but developed as a free and open alternative. Today, Linux powers servers, cloud infrastructure, Android devices, IoT, cybersecurity, DevOps, and AI research.

Recently we have started working on a research project with a high level requirements as under:
✅ Crawls public websites for topics of your interest ( e.g. Java ).
✅ Extracts potential Java questions and generates high-quality answers consulting multiple LLMs.
✅ Uses LLMs (Large Language Models) for Q&A generation, topic classification, and logical error analysis.
✅ Runs a scheduled batch inference processing system for efficiency.
✅ Uses PostgreSQL for structured data storage and LLMs for semantic search.
✅ Optimizes inference performance on a local Linux environment using WSL and SSD-based swap.
✅ Implements benchmarking & auto-routing for cost-effective LLM selection (local hosted models and cloud hosted like Groq, GPT-4).

--

--

Rajesh Kanade
Rajesh Kanade

Written by Rajesh Kanade

Rajesh Kanade, Founder, Grey Neurons Consulting Linked In : https://www.linkedin.com/in/rkanade/

No responses yet