Skip to content
cccskills
FreePublished on GitHub

doris-docker-regression

Prepare a clean Doris package and run Docker regression tests, which check whether changes break existing behavior. Restore configuration and startup files from Git, build the test image, and investigate failures using configuration checks and runtime logs.

OriginalShow the original description

Run Doris docker-based regression tests from a clean package

Works withDocker
See how to install

Good for

  • Run Docker regression tests before submitting Doris changes
  • Test without local configuration changes affecting results
  • Investigate missing test suites or startup failures
  • Locate runtime cluster logs after a test failure

Files included (1)

  • SKILL.md3.8 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Purpose

Run Doris docker-based regression tests from a clean package, avoiding contamination from local conf/ or startup script modifications.

Prerequisites

Python Environment

Requires Python 3. Install dependencies from docker/runtime/doris-compose/requirements.txt:

python -m pip install --user -r docker/runtime/doris-compose/requirements.txt

If installation fails (especially PyYAML conflicts), use specific versions:

python -m pip install --user pyyaml==5.3.1 docker==6.1.3
python -m pip install --user -r docker/runtime/doris-compose/requirements.txt

Alternatively, use a virtual environment:

python -m venv doris-compose-env
source doris-compose-env/bin/activate
pip install -r docker/runtime/doris-compose/requirements.txt

Docker Environment

docker run hello-world       # Docker works
docker compose version       # Compose v2
docker-compose version       # Should resolve to Compose v2

If docker-compose shows TypeError: kwargs_from_env(), make sure it is indeed Docker Compose V2; if not, you need to install and point to the correct version.

Check port availability:

lsof -nP -iTCP:8030,8040,8050,8060,8070,9010,9020,9030,9050,9060 -sTCP:LISTEN

If there is a conflict, ask the user how to handle it.

Build

./build.sh --fe --be -j<parallel_jobs> --output <output_directory>

Prepare Clean Package

Sanitize configs from git HEAD:

git show HEAD:conf/fe.conf > <output_directory>/fe/conf/fe.conf
git show HEAD:conf/be.conf > <output_directory>/be/conf/be.conf
git show HEAD:bin/start_fe.sh > <output_directory>/fe/bin/start_fe.sh
chmod 755 <output_directory>/fe/bin/start_fe.sh

Verify clean configs use default ports:

  • fe.conf: 8030, 9020, 9030, 9010, 8070
  • be.conf: 9060, 8040, 9050, 8060, 8050
  • start_fe.sh: no -agentlib:jdwp debug agent

Build Docker Image

docker build \
  --build-arg OUTPUT_PATH=<output_directory> \
  -f docker/runtime/doris-compose/Dockerfile \
  -t <image_name>:latest \
  .

Configure Regression

Create regression-test/conf/regression-conf-custom.groovy:

image = "<image_name>:latest"
excludeDockerTest = false
testGroups = "docker"

Run Regression

./run-regression-test.sh --run -d <directory> -s <suite_name>

Troubleshooting

SymptomCauseFix
0 suitesexcludeDockerTest=true or missing testGroups="docker"Check regression-conf-custom.groovy
JDWP errorstart_fe.sh has debug agentRe-sanitize from git show HEAD:bin/start_fe.sh
Wrong portsConfigs have local editsRe-sanitize from git show HEAD:conf/fe.conf / be.conf
Port conflictProcesses using default portslsof then kill

Debug Logs

Runtime cluster at /tmp/doris/<suite_name>/:

  • fe-1/log/fe.log, fe.warn.log, fe.out, health.out
  • be-1/log/be.INFO, be.WARNING, be.out, health.out
  • doris-compose.log

Full Command Sequence

# 1. Check environment
python --version
docker run hello-world
docker compose version
lsof -nP -iTCP:8030,8040,8050,8060,8070,9010,9020,9030,9050,9060 -sTCP:LISTEN

# 2. Build
./build.sh --fe --be -j60

# 3. Sanitize package configs
git show HEAD:conf/fe.conf > <output_directory>/fe/conf/fe.conf
git show HEAD:conf/be.conf > <output_directory>/be/conf/be.conf
git show HEAD:bin/start_fe.sh > <output_directory>/fe/bin/start_fe.sh
chmod 755 <output_directory>/fe/bin/start_fe.sh

# 4. Build image
docker build --build-arg OUTPUT_PATH=<output_directory> -f docker/runtime/doris-compose/Dockerfile -t <image_name>:latest .

# 5. Configure (create regression-conf-custom.groovy)
# 6. Run
./run-regression-test.sh --run -d <directory> -s <suite_name>

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

be-code-style

FreeSummary

Format C++ code in the BE and Cloud modules using the project's clang-format v16 rules. Use the provided scripts to fix formatting or check for violations without changing files, then review the resulting differences before committing.

  • Format BE or Cloud C++ code before committing
  • Fix formatting failures reported by CI
  • Check formatting without modifying files
apache/doris16.1KUpdated Oct 18, 2026

clang-tidy-check

FreeSummary

Run clang-tidy static analysis, which checks code without executing it, on added or modified BE and Cloud C++ files. Focus diagnostics on changed lines, investigate bug, performance, and readability warnings, and verify fixes with another check.

  • Check changed C++ code before committing
  • Investigate clang-tidy warnings reported by CI
  • Review changes against a specific branch
apache/doris16.1KUpdated Oct 18, 2026

code-review

FreeSummary

Review Doris code changes using project-specific checklists for data correctness, concurrency, memory safety, compatibility, performance, and tests. Trace related code paths and explain findings with concrete failure scenarios, using query plan trees when reviewing optimizer behavior.

  • Review newly completed Doris code changes
  • Check concurrency and memory management in related code paths
  • Assess compatibility and test coverage before merging
apache/doris16.1KUpdated Oct 18, 2026

fe-code-style

FreeSummary

Diagnoses and fixes Java style violations in the FE module using Checkstyle, a tool that checks coding rules. It interprets errors, applies the project's formatting and import restrictions, and reruns checks to verify fixes.

  • Checking FE Java changes before committing
  • Fixing build failures caused by Checkstyle violations
  • Understanding project-specific style and import rules
apache/doris16.1KUpdated Oct 18, 2026

See all skills by apache

Report a problem with this skill