跳到正文
cccskills
免费在 GitHub 公开

doris-docker-regression

Prepare a clean Doris package and run Docker regression tests, which check whether changes break existing behavior. Restore configuration and startup files from Git, build the test image, and investigate failures using configuration checks and runtime logs.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

Run Doris docker-based regression tests from a clean package

集成工具Docker
查看安装方法

适用场景

  • Run Docker regression tests before submitting Doris changes
  • Test without local configuration changes affecting results
  • Investigate missing test suites or startup failures
  • Locate runtime cluster logs after a test failure

包含的文件(1)

  • SKILL.md3.8 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Purpose

Run Doris docker-based regression tests from a clean package, avoiding contamination from local conf/ or startup script modifications.

Prerequisites

Python Environment

Requires Python 3. Install dependencies from docker/runtime/doris-compose/requirements.txt:

python -m pip install --user -r docker/runtime/doris-compose/requirements.txt

If installation fails (especially PyYAML conflicts), use specific versions:

python -m pip install --user pyyaml==5.3.1 docker==6.1.3
python -m pip install --user -r docker/runtime/doris-compose/requirements.txt

Alternatively, use a virtual environment:

python -m venv doris-compose-env
source doris-compose-env/bin/activate
pip install -r docker/runtime/doris-compose/requirements.txt

Docker Environment

docker run hello-world       # Docker works
docker compose version       # Compose v2
docker-compose version       # Should resolve to Compose v2

If docker-compose shows TypeError: kwargs_from_env(), make sure it is indeed Docker Compose V2; if not, you need to install and point to the correct version.

Check port availability:

lsof -nP -iTCP:8030,8040,8050,8060,8070,9010,9020,9030,9050,9060 -sTCP:LISTEN

If there is a conflict, ask the user how to handle it.

Build

./build.sh --fe --be -j<parallel_jobs> --output <output_directory>

Prepare Clean Package

Sanitize configs from git HEAD:

git show HEAD:conf/fe.conf > <output_directory>/fe/conf/fe.conf
git show HEAD:conf/be.conf > <output_directory>/be/conf/be.conf
git show HEAD:bin/start_fe.sh > <output_directory>/fe/bin/start_fe.sh
chmod 755 <output_directory>/fe/bin/start_fe.sh

Verify clean configs use default ports:

  • fe.conf: 8030, 9020, 9030, 9010, 8070
  • be.conf: 9060, 8040, 9050, 8060, 8050
  • start_fe.sh: no -agentlib:jdwp debug agent

Build Docker Image

docker build \
  --build-arg OUTPUT_PATH=<output_directory> \
  -f docker/runtime/doris-compose/Dockerfile \
  -t <image_name>:latest \
  .

Configure Regression

Create regression-test/conf/regression-conf-custom.groovy:

image = "<image_name>:latest"
excludeDockerTest = false
testGroups = "docker"

Run Regression

./run-regression-test.sh --run -d <directory> -s <suite_name>

Troubleshooting

SymptomCauseFix
0 suitesexcludeDockerTest=true or missing testGroups="docker"Check regression-conf-custom.groovy
JDWP errorstart_fe.sh has debug agentRe-sanitize from git show HEAD:bin/start_fe.sh
Wrong portsConfigs have local editsRe-sanitize from git show HEAD:conf/fe.conf / be.conf
Port conflictProcesses using default portslsof then kill

Debug Logs

Runtime cluster at /tmp/doris/<suite_name>/:

  • fe-1/log/fe.log, fe.warn.log, fe.out, health.out
  • be-1/log/be.INFO, be.WARNING, be.out, health.out
  • doris-compose.log

Full Command Sequence

# 1. Check environment
python --version
docker run hello-world
docker compose version
lsof -nP -iTCP:8030,8040,8050,8060,8070,9010,9020,9030,9050,9060 -sTCP:LISTEN

# 2. Build
./build.sh --fe --be -j60

# 3. Sanitize package configs
git show HEAD:conf/fe.conf > <output_directory>/fe/conf/fe.conf
git show HEAD:conf/be.conf > <output_directory>/be/conf/be.conf
git show HEAD:bin/start_fe.sh > <output_directory>/fe/bin/start_fe.sh
chmod 755 <output_directory>/fe/bin/start_fe.sh

# 4. Build image
docker build --build-arg OUTPUT_PATH=<output_directory> -f docker/runtime/doris-compose/Dockerfile -t <image_name>:latest .

# 5. Configure (create regression-conf-custom.groovy)
# 6. Run
./run-regression-test.sh --run -d <directory> -s <suite_name>

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Format C++ code in the BE and Cloud modules using the project's clang-format v16 rules. Use the provided scripts to fix formatting or check for violations without changing files, then review the resulting differences before committing.

中文简介正在准备中。当前显示英语简介。

  • Format BE or Cloud C++ code before committing
  • Fix formatting failures reported by CI
  • Check formatting without modifying files
apache/doris1.6万2026年10月18日 更新

Run clang-tidy static analysis, which checks code without executing it, on added or modified BE and Cloud C++ files. Focus diagnostics on changed lines, investigate bug, performance, and readability warnings, and verify fixes with another check.

中文简介正在准备中。当前显示英语简介。

  • Check changed C++ code before committing
  • Investigate clang-tidy warnings reported by CI
  • Review changes against a specific branch
apache/doris1.6万2026年10月18日 更新

Review Doris code changes using project-specific checklists for data correctness, concurrency, memory safety, compatibility, performance, and tests. Trace related code paths and explain findings with concrete failure scenarios, using query plan trees when reviewing optimizer behavior.

中文简介正在准备中。当前显示英语简介。

  • Review newly completed Doris code changes
  • Check concurrency and memory management in related code paths
  • Assess compatibility and test coverage before merging
apache/doris1.6万2026年10月18日 更新

Diagnoses and fixes Java style violations in the FE module using Checkstyle, a tool that checks coding rules. It interprets errors, applies the project's formatting and import restrictions, and reruns checks to verify fixes.

中文简介正在准备中。当前显示英语简介。

  • Checking FE Java changes before committing
  • Fixing build failures caused by Checkstyle violations
  • Understanding project-specific style and import rules
apache/doris1.6万2026年10月18日 更新

查看 apache 的全部技能

报告此技能的问题