CodeFinetuner Released: LoRA-based Local Code Autocomplete Model Fine-Tuning Tool Open-Sourced

Summary:CodeFinetuner is an open-source tool for fine-tuning local code autocomplete models using LoRA (Low-Rank Adaptation) technology. It supports training on Mac (MPS) and NVIDIA GPUs (CUDA) with optional Unsloth support for faster training and lower VRAM usage. Users can fine-tune small code completion models (e.g., Qwen2.5-Coder-3B) and generate GGUF models for use with local editors like llama.vim and llama.vscode. While the tool demonstrates clear improvements on evaluation metrics, its real-worl

---

Overview

CodeFinetuner is a specialized fine-tuning tool for local code autocomplete models, designed to help developers customize models based on their own codebases to enhance the accuracy and efficiency of code completion. The tool leverages LoRA (Low-Rank Adaptation) technology, supports training on Mac (MPS) and NVIDIA GPUs (CUDA), and offers optional Unsloth support for faster training and lower VRAM usage.

Key Features

• Multi-platform Support: Training is supported on Mac (MPS) and NVIDIA GPUs (CUDA).
• LoRA-based Fine-tuning: Utilizes LoRA technology for efficient model fine-tuning, reducing computational resource requirements.
• Optional Unsloth Support: Further accelerates the training process and reduces VRAM usage.
• Comprehensive Fine-tuning Pipeline: From raw code to GGUF model conversion, covering parsing, fine-tuning, and evaluation steps.
• Multi-metric Evaluation: Includes CodeBLEU, edit similarity, exact match rate, and perplexity.

Technical Highlights

1. Structured Data Processing: Uses tree-sitter to parse code into structured FIM (Fill-in-the-Middle) examples, improving fine-tuning effectiveness.
2. Flexible Fine-tuning Configuration: Users can adjust configuration parameters based on their hardware and requirements.
3. Local Deployment: Generated GGUF models can be used with local editors like llama.vim and llama.vscode, eliminating the need for cloud services.

Usage

1. Install the tool: Use the command uv tool install codefinetuner.
2. Prepare data: Create a data folder and place your codebase or code files inside.
3. Configure training: Download the default configuration file and adjust it as needed.
4. Start Fine-tuning: Run the command codefinetuner --config="codefinetuner_config.yaml" to begin the fine-tuning process.

Industry Impact

The release of CodeFinetuner provides developers with an efficient and flexible solution for fine-tuning code completion models, particularly in scenarios where highly customized code completion tools are required. Although its real-world performance requires further validation, its open-source nature and comprehensive toolchain make it an important tool in the AI-assisted programming domain.

Developer Recommendations

• Hardware Requirements: It is recommended to use NVIDIA GPUs for optimal performance.
• Data Preparation: Ensure the quality and diversity of the codebase to achieve better fine-tuning results.
• Model Evaluation: Test the fine-tuned model in the editor to evaluate its real-world performance.

Conclusion

CodeFinetuner offers developers a powerful tool for local code autocomplete model fine-tuning. Its open-source nature and flexible hardware support make it a valuable asset in the AI-assisted programming landscape.

---

Source: Reddit r/LocalLLaMA (2026-09-11)

— END —

Tags: #CodeFinetuner #LoRA #Open-Source Tool #Code Autocomplete #AI-Assisted Programming