'gguf' 검색 결과

Find and run local AI models with llama.cpp. Choose GGUF model files and quantization levels that fit available memory, launch a command line session or local server, and test an OpenAI-compatible API on your computer.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Find models to run on a local computer
• Choose quantization for available memory
• Launch and test a local OpenAI-compatible API

Convert language models to GGUF and reduce their size through quantization, which stores model weights at lower precision. Guides cover compression choices, local inference on CPUs and Apple Silicon, and integration with tools such as Ollama.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running a language model on a CPU-only computer
• Choosing model compression for available memory
• Configuring Metal acceleration on Apple Silicon

Find language models on Hugging Face Hub and run them locally with llama.cpp. The skill helps compare GGUF model files, choose compressed versions that fit available memory, and prepare commands for a local chat server or command-line session.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Find a model that fits local RAM or GPU memory
• Compare available GGUF files and sizes
• Prepare a local chat server command

Train or fine-tune language and vision models on Hugging Face Jobs without a local GPU. Covers dataset checks, hardware and cost planning, training monitoring, Hub storage, and GGUF conversion for local use.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Fine-tune a language model without a local GPU
• Validate preference data before DPO training
• Estimate training costs and choose GPU hardware

Estimate inference memory for models on Hugging Face Hub without downloading their weights. Check GPU capacity for Safetensors or GGUF files, with optional estimates for the KV cache, memory used to retain attention data during generation.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Check whether a model fits on a GPU
• Compare memory estimates for GGUF quantizations
• Estimate KV cache memory for a chosen context length

Convert LLMs to GGUF and reduce model size through quantization, which stores weights at lower numerical precision. Prepare models for CPU or Apple Silicon inference, compare compression levels, and integrate them with local AI tools.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Preparing an LLM for CPU-only use
• Running a local model on Apple Silicon
• Comparing model size and quality across quantization levels

Run language models locally with llama.cpp on CPUs, Apple Silicon, or AMD and Intel GPUs. The skill guides model setup, memory-saving GGUF format choices, interactive chat, and serving models through an OpenAI-compatible API.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running a language model on a CPU-only computer
• Setting up local chat on an Apple Silicon Mac
• Choosing model quantization to fit available memory

Guides you through running large language models on CPUs, Apple Silicon, and AMD or Intel GPUs. Covers choosing GGUF model files, reducing memory through quantization, and starting an OpenAI-compatible chat server.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Running a local LLM on an Apple Silicon Mac
• Trying LLM inference on a CPU-only machine
• Choosing a model format that fits available memory

Export an approved fine-tuned model into a format suited to its hardware and runtime. Choose weight packaging and quantization, which reduces numerical precision, then compare outputs before and after export to check for regressions.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Exporting a checkpoint approved for deployment
• Choosing a model format for a target GPU or laptop
• Comparing outputs before and after export

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Formato GGUF e quantização llama.cpp para inferência eficiente em CPU/GPU. Use ao implantar modelos em hardware de consumidor, Apple Silicon, ou quando precisar de quantização flexível de 2-8 bits sem requisitos de GPU.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Build Lightricks LTX-2 / LTX-2.3 video workflows covering text-to-video, image-to-video, GGUF and bundled checkpoints, distilled model, camera control LoRAs, synchronized audio, two-stage upscaling, and swapping alternate/GGUF base models

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

在本机 Mac 或 Apple Silicon 上部署 Gemma 4 12B。本地安装/升级 llama.cpp，下载 GGUF 量化模型，用 llama-server 暴露 OpenAI-compatible API，或用 Ollama 暴露本地模型服务；按用户需求在默认 Q4_K_M、64K/128K 长上下文、QAT Q4_0 @ 256K、左右对比演示之间选择，配置 tmux 后台运行，验证健康检查、问答接口、资源占用和常见故障。当用户说部署 Gemma 4、Gemma 4 12B、本地大模型、长上下文、QAT、量化、llama-server、Ollama、GGUF、Mac 本地模型服务时使用。

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Expert guide for synthetic dataset generation, LLM-as-a-judge filtering, QLoRA fine-tuning (Unsloth), DPO alignment, and GGUF/Ollama export for local SLMs / Panduan ahli generasi data sintetis, fine-tuning QLoRA, DPO, dan ekspor GGUF/Ollama.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Run GGUF models directly, load LoRA adapters, benchmark inference speed, and serve models via llama-server using llama.cpp. Includes Qwen 3.5 serve scripts (9B dense + F16, 35B MoE) with asymmetric KV cache and thinking mode. Secondary to Ollama; use when needing direct model control or LoRA hot-loading. Triggers on 'llama.cpp', 'GGUF', 'LoRA adapter', 'benchmark inference', 'llama-server'.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Executa inferência de LLM em CPU, Apple Silicon e GPUs consumer sem hardware NVIDIA. Use para edge deployment, Macs M1/M2/M3, GPUs AMD/Intel ou quando CUDA não está disponível. Suporta quantização GGUF (1,5-8 bits) para redução de memória e aceleração de 4-10× vs PyTorch em CPU.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Train or fine-tune language and vision models using TRL (Transformer Reinforcement Learning) or Unsloth with Hugging Face Jobs infrastructure. Covers SFT, DPO, GRPO and reward modeling training methods, plus GGUF conversion for local deployment. Includes guidance on the TRL Jobs package, UV scripts with PEP 723 format, dataset preparation and validation, hardware selection, cost estimation, Trackio monitoring, Hub authentication, model selection/leaderboards and model persistence. Use for tasks involving cloud GPU training, GGUF conversion, or when users mention training on Hugging Face Jobs without local GPU setup.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Configure Hermes to run AI models through Actual Computer on your own hardware. Set up either the hosted relay or a local connection, select models, verify responses, and troubleshoot request errors or empty output.

한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.

• Connecting Hermes with an Actual inference key
• Running models through a local Actual daemon
• Downloading and loading local models

Best practices for the Common utilities package in LlamaFarm. Covers HuggingFace Hub integration, GGUF model management, and shared utilities.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.