Use Meta's Prompt Guard to detect malicious instructions in user prompts and external data. This skill guides input filtering, batch checks for retrieved documents, detection threshold adjustments, and splitting long text for inspection.
中文简介正在准备中。当前显示英语简介。
Detecting attempts to override an LLM's instructions
Checking API responses for embedded malicious instructions
Compress large language models to 4-bit weights to reduce GPU memory needs and accelerate text generation. Covers loading compressed models, converting your own models, choosing settings, and preparing memory-efficient fine-tuning with transformers and PEFT.
中文简介正在准备中。当前显示英语简介。
Run language models with limited GPU memory
Convert your own model to 4-bit weights
Compare compression settings for quality and speed
