Improving Python coverage
SkillDev toolsLets your agent measure Python test coverage and write new unit tests to raise it.
Available today. Use it from your connected AI after setup.
No other account needed.
Add ahel to your AI once: Claude, ChatGPT, Cursor, Claude Code or Codex. Then ask it to use this.
Then ask your AI: use the Improving Python coverage skill
About this skill
Runs Python unit tests with coverage, analyzes coverage reports, and implements meaningful tests to increase coverage by ~0.2%. Use when you want to systematically improve Python test coverage with high-value test cases.
What this skill tells your AI
The instructions your AI receives, as published by streamlit/streamlit in .claude/skills/improving-python-coverage/SKILL.md and read by ahel’s review.
Increase Python unit test coverage by ~0.2% through meaningful tests that add real value.
Be fully autonomous — Do NOT stop or pause to ask for confirmation. Keep iterating (analyze → implement → verify) until the 0.2% coverage target is reached. If you encounter ambiguities about what to test, make a reasonable choice and proceed.
Workflow
Step 1: Run tests with coverage
make python-tests # ~3 min, creates .coverage file
Generate JSON report for analysis:
uv run coverage json -o coverage.json
The JSON contains per-file missing_lines arrays showing uncovered line numbers.
Step 2: Analyze and prioritize
Read coverage.json to find files with:
- Large size + below-average
percent_covered(high impact) - Core modules in
lib/streamlit/elements/orlib/streamlit/runtime/ - Pure utility functions
Skip: >97% coverage, proto/*, vendor/*, static/*, test files.
Step 3: Implement tests (in subagent)
Launch a subagent to implement tests for each prioritized file. Provide the subagent with:
- The target file path and its
missing_linesfrom coverage - Instructions to read the source, existing tests, and write new tests
- The test selection guidelines below
The subagent should:
- Read source and existing tests at
lib/tests/streamlit/<path>/<module>_test.py - Write tests for: conditional branches, error handling, edge cases, exception paths
- Follow
lib/tests/AGENTS.md: prefer pytest-style standalone functions overunittest.TestCaseclasses, use@pytest.mark.parametrizeto consolidate tests that only differ in inputs/expected outputs, add numpydoc docstrings and type annotations - Run the new tests to verify they pass:
uv run pytest lib/tests/streamlit/path/to/module_test.py -v
Step 4: Verify and iterate
uv run pytest lib/tests/streamlit/path/to/module_test.py -v # Run new tests
make python-tests # Measure progress
Repeat steps 2-4 until coverage improves by ≥0.2%, then run make check.
Step 5: Simplify, review, and address feedback
Once all tests pass and coverage target is met:
- Run the
simplifying-local-changessubagent to clean up and simplify the code changes. Wait for completion. - Run the
reviewing-local-changessubagent to review the changes. Wait for completion and read the review output. - Address the review feedback: for each recommendation, implement it if valid and improves code quality; skip with brief reasoning if not applicable or would over-engineer.
- Run /checking-changes to verify everything still passes after changes.
Test selection
DO test: Conditional logic, error handling, edge cases (None, empty, zero, max), public API functions, complex branches.
DON'T test: Simple accessors, protobufs, implementation details, already well-covered code.
Coverage exclusions: Use # pragma: no cover sparingly for code that genuinely doesn't need testing. Always include a reason (e.g., # pragma: no cover - defensive):
- Platform-specific branches that can't run in CI (
# pragma: no cover - platform-specific) - Defensive code that should never execute (
# pragma: no cover - defensive) - Abstract method stubs or protocol definitions (
# pragma: no cover - abstract)
Integration dependencies: Packages listed under [dependency-groups] integration in pyproject.toml (e.g., pydantic, sympy, polars, sqlalchemy) are only installed for integration tests, not regular unit tests. When writing tests that use these packages:
- Import them inside the test function, not at module top-level
- Add
@pytest.mark.require_integrationmarker to the test - This ensures tests gracefully skip when run outside the integration test environment
Test file location
lib/tests/streamlit/<package>/<module>_test.py mirrors lib/streamlit/<package>/<module>.py
Notes
-
Quality > coverage numbers - skip tests that don't catch real bugs
-
Target is 95%+ coverage per
lib/tests/AGENTS.md -
Use
/checking-changesafter implementing tests -
Some code paths involving external libraries (e.g., database connectors, optional dependencies) are already covered by integration tests marked with
pytest.mark.require_integration. These integration tests are not included in the coverage numbers frommake python-tests. When analyzing missing lines, check whether the uncovered code is exercised by integration tests before adding unit tests or# pragma: no coverannotations. -
Local vs CI coverage differences: Code that is version-specific (Python version, library version) or uses integration dependencies may appear uncovered locally but is tested and covered in CI. Examples:
- Python version-specific branches (e.g.,
if sys.version_info >= (3, 14)) run only on matching CI jobs - Library version-specific code (e.g., pandas 2.x vs 3.x behavior) is covered across CI matrix
- Integration dependency tests (
@pytest.mark.require_integration) run in separate CI jobs with those packages installed
Before adding tests or
# pragma: no coverfor such code, verify whether it's already exercised in CI. - Python version-specific branches (e.g.,
Signals
- GitHub stars
- 46k
- Forks
- 4k
- Last commit
- Sep 2026
Advanced
- Item type
- skill
- Key
improving-python-coverage- Source
- github.com/streamlit/streamlit