Local Deployment of DeepSeek

Why Use a Local Large Model

1. The DeepSeek official website has been extremely popular recently and often fails to respond
   

2. Local deployment offers higher security

3. Local deployment can bypass some official restrictions

Test Environment

OS: Windows 10 Pro 22H2
CPU: AMD Ryzen 5 5600H (6C12T, Base 3.3GHz / Boost 4.2GHz)
GPU: NVIDIA GeForce RTX 3050 Ti Laptop GPU (4GB GDDR6 VRAM)
RAM: SAMSUNG 16GB DDR4-3200
IDE: LM Studio v0.3.9

Deployment Method

0. It is recommended to use an international network environment and enable TUN mode in your proxy tool

1. Download and install the LM Studio client
   Click to go

2. Change the model download directory (recommended)
   This prevents models from consuming too much space on the C drive
   

3. Download the appropriate model based on your computer configuration
   Models with Distill in the name are distilled models
   The recommended model is DeepSeek-R1-Distill-Llama-8B-Abliterated-GGUF, which runs smoothly with 4GB of VRAM. This model also removes some of DeepSeek's built-in restrictions, allowing more freedom in local use
   

4. Load the model
   After the download completes, click the top bar to load the model you just downloaded
   It is recommended to increase GPU Offload and enable Fast Attention for better performance
   

5. Start using it
   

Advanced Usage