31 个 · 按相关度排序
Build text tokenizers that split multilingual text into small units for AI models. Learn how to train SentencePiece on raw text, configure BPE or Unigram splitting methods, and convert text to token IDs and back.
中文简介正在准备中。当前显示英语简介。
Build text tokenizers, which split text into units for AI models, directly from raw multilingual text. Learn custom vocabularies with BPE or Unigram, convert text to pieces or numeric IDs, and decode the results.
中文简介正在准备中。当前显示英语简介。
Prepare text for language models using HuggingFace Tokenizers, which splits text into model-readable units. Train custom vocabularies, process batches, track original text positions, and configure input lengths for use with transformers.
中文简介正在准备中。当前显示英语简介。
Prepare large text collections for AI models with fast tokenizers, which split text into model inputs. Train custom vocabularies, trace tokens to original text positions, adjust input lengths, and integrate the results with transformers.
中文简介正在准备中。当前显示英语简介。
Fast tokenizers optimized for research and production. Rust-based implementation tokenizes 1GB in <20 seconds. Supports BPE, WordPiece, and Unigram algorithms. Train custom vocabularies, track alignments, handle padding/truncation. Integrates seamlessly with transformers. Use when you need high-performance tokenization or custom tokenizer training.
中文简介正在准备中。当前显示原文说明。
Language-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), deterministic vocabulary. Used by T5, ALBERT, XLNet, mBART. Train on raw text without pre-tokenization. Use when you need multilingual support, CJK languages, or reproducible tokenization.
中文简介正在准备中。当前显示原文说明。
Fast tokenizers optimized for research and production. Rust-based implementation tokenizes 1GB in <20 seconds. Supports BPE, WordPiece, and Unigram algorithms. Train custom vocabularies, track alignments, handle padding/truncation. Integrates seamlessly with transformers. Use when you need high-performance tokenization or custom tokenizer training.
中文简介正在准备中。当前显示原文说明。
将文本拆分为供AI模型使用的小单位，并转换为数字序列。支持批量处理、自定义词表训练、原文位置对应，以及通过截断和填充统一输入长度。
Prepare and analyze genomic intervals, regions defined by chromosome coordinates, with Gtars. Validate BED files, compare overlaps and coverage, combine region sets, and plan tokenization or reference storage while tracking data provenance and resource limits.
中文简介正在准备中。当前显示英语简介。
PCI DSS v4.0 payment card data security compliance, assessment, and implementation. Use for PCI DSS scoping, cardholder data environment (CDE) security, SAQ and ROC preparation, QSA engagement, tokenization, and merchant compliance.
中文简介正在准备中。当前显示原文说明。
Assessment of pseudonymization techniques and re-identification risk. Covers tokenization, hashing, encryption-based pseudonymization, and hybrid approaches. Includes re-identification risk scoring using the motivated intruder test, quantitative metrics (marketer, journalist, prosecutor models), and linkage attack resilience evaluation. References ENISA 2019 pseudonymization report.
中文简介正在准备中。当前显示原文说明。
为孟加拉语搜索和AI处理整理字符表示统一、分词、数字转换及不破坏连字的显示方法，也可用于准备训练数据和存储文本。
Help secure payment systems using PCI DSS, the payment card data security standard. Covers encryption, log masking, access controls, and tokenization, which replaces card details with substitute values to reduce direct handling of sensitive data.
中文简介正在准备中。当前显示英语简介。
Add or verify model support in SGLang's Rust processor so chat requests produce the same prompt text and token IDs as Python. Use reference-generated test cases to find differences in tools, reasoning settings, conversation history, and errors.
中文简介正在准备中。当前显示英语简介。
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
中文简介正在准备中。当前显示原文说明。
A high-performance Rust toolkit (with Python bindings and a CLI) for genomic interval analysis; use it when you need fast overlap queries, coverage track generation, genomic tokenization for ML, reference sequence verification, or fragment processing.
中文简介正在准备中。当前显示原文说明。
Audit applications and infrastructure handling payment card data against PCI DSS v4.0. Heavy emphasis on scope determination (the single most-leveraged variable) plus the engineering-relevant requirements — Req 3 (storage of CHD), Req 4 (transmission), Req 6 (secure SDLC), Req 7-8 (access), Req 10 (logging), Req 11 (testing), Req 12 (program). Use when the user mentions 'PCI,' 'PCI DSS,' 'PCI DSS 4.0,' 'payment card,' 'cardholder data,' 'CHD,' 'PAN,' 'PCI scope,' 'PCI compliance,' 'SAQ,' 'AoC,' 'attestation of compliance,' 'tokenization,' 'P2PE,' 'network segmentation for PCI,' or audits any system that stores, processes, or transmits payment card data.
中文简介正在准备中。当前显示原文说明。
High-performance toolkit for genomic interval analysis in Rust with Python bindings. Use when working with genomic regions, BED files, coverage tracks, overlap detection, tokenization for ML models, or fragment analysis in computational genomics and machine learning applications.
中文简介正在准备中。当前显示原文说明。
Rust-backed Python library for fast genomic token arithmetic and BED processing. High-performance BED I/O, interval set ops (intersect, merge, complement, subtract), region tokenization against a universe, universe construction. Use for preprocessing large BED collections and ML token vocabularies.
中文简介正在准备中。当前显示原文说明。
HuggingFace Transformers with biomedical LMs (BioBERT, PubMedBERT, BioGPT, BioMedLM) for scientific NLP: NER (genes, diseases, chemicals), relation extraction, QA, text classification, abstract summarization. Covers loading, biomedical tokenization, inference pipelines, fine-tuning. Alternatives: spaCy en_core_sci_lg (rule-based NER), Stanza (biomedical models), NLTK.
中文简介正在准备中。当前显示原文说明。
Applies the mental models and frameworks of Andrej Karpathy (deep learning, former Director of AI at Tesla, founding member of OpenAI, Eureka Labs). Use this skill whenever you are helping the user build neural networks from scratch, debug deep learning pipelines, evaluate AI agent workflows, design LLM apps, or navigate the transition to Software 3.0 (vibe coding). It is highly relevant for pedagogy (untangling complex knowledge), assessing AI capabilities vs. limitations (jagged intelligence, tokenization limits), and architectural decisions (end-to-end optimization vs. complex pipelines). Reach for this whenever discussing LLM training, autonomous systems, or AI-assisted coding.
中文简介正在准备中。当前显示原文说明。
Applies the mental models and frameworks of Andrej Karpathy (deep learning, former Director of AI at Tesla, founding member of OpenAI, Eureka Labs). Use this skill whenever you are helping the user build neural networks from scratch, debug deep learning pipelines, evaluate AI agent workflows, design LLM apps, or navigate the transition to Software 3.0 (vibe coding). It is highly relevant for pedagogy (untangling complex knowledge), assessing AI capabilities vs. limitations (jagged intelligence, tokenization limits), and architectural decisions (end-to-end optimization vs. complex pipelines). Reach for this whenever discussing LLM training, autonomous systems, or AI-assisted coding.
中文简介正在准备中。当前显示原文说明。
Use Neo4j GenAI Plugin ai.text.* functions and procedures for in-Cypher embedding generation, text completion, structured output, chat, tokenization, and batch ingestion. Covers ai.text.embed(), ai.text.embedBatch(), ai.text.completion(), ai.text.structuredCompletion(), ai.text.aggregateCompletion(), ai.text.chat(), ai.text.tokenCount(), ai.text.chunkByTokenLimit(), and provider configuration for OpenAI, Azure OpenAI, VertexAI, and Amazon Bedrock. Requires CYPHER 25. Replaces deprecated genai.vector.encode(). Use when writing pure-Cypher GraphRAG, embedding nodes in-graph, generating structured maps from prompts, or calling LLMs inside Cypher queries. Does NOT handle neo4j-graphrag Python library pipelines — use neo4j-graphrag-skill. Does NOT handle vector index creation/search — use neo4j-vector-index-skill.
中文简介正在准备中。当前显示原文说明。
Fintech engineering expertise — payment processing (Stripe, Plaid), PCI DSS compliance, financial data modeling (double-entry bookkeeping), fraud detection patterns, bank-grade security (encryption, tokenization), open banking APIs, cryptocurrency/blockchain integration, regulatory compliance (KYC/AML), and idempotent financial transaction design. Use for payment systems, banking apps, trading platforms, and fintech infrastructure.
中文简介正在准备中。当前显示原文说明。