Langchain

3 articles

azure c++ computer vision cpp data analytics decorator deep learning game server geospatial data geosql GPU image segmentation Langchain LLM LM Studio machine learning multithreading network programming object oriented programming oop Optuna python pytorch RAG segformer synapse analytics tcp threads udp voice recognition

<RAG> 2. Collecting RAG Data Using LLM

Friday, May 16, 2025

Scraping data will give us large volume of data in small time, but we need a way more structured type of data for the model to process if we’re going to use this data in the RAG dataset. Summarizing this data by hand will take a very long time, so we will use the LLM to summarize our scraped data for us. Coming up with a good data structure Funnily, one of the best usage of LLM is to as how to better use an LLM in a project.

Jun Yeop(Johnny) Na

<RAG> 3. Setting Up Baseline LLM Prompt For Service

Friday, May 16, 2025

While Gemini summarizes my dataset, I’ll be creating an LLM server skeleton to use in the project. Backend Model Structure We’re going to provide an LLM Adapter so that we can easily transfer from local smaller LLM and larger LLM hosted by bigger companies LLM Request Adapter """Provides API for requesting Online and Offline LLM Character Evaluation """ from abc import abstractmethod class LlmCharacterEvalAdapter: @abstractmethod def get_character_evaluation_from_llm(self, character_eval_request) -> CharacterEvalResponse: """Request Character Evaluation to the target LLM with the given request format.

Jun Yeop(Johnny) Na

<RAG> 1. Tuning LLM Using Langchain + LM Studio

Friday, May 2, 2025

I’m working on a story evaluation AI Agent. I’m going to tune the model using Langchain with a local LLM using LM Studio 1. Setting up LM Studio Tool for downloading and running local LLM model that fits your local environment. Download: https://lmstudio.ai/ Install and we’ll be asked to download Qwen B7 for onboarding. After downloading, we can run the model Run the model and we’ll se a chatbot environment pop up.

Jun Yeop(Johnny) Na