feat(python): add stack-advanced gate scenarios for 3.14/3.15 (PROF-15511)

[vlad-scherbich]

Prev: #169 (merged) | Next: #172 | Base: main

Summary

Adds 4 families × 2 versions (8 dirs): alloc, asyncio, native_cpu, deep_stack.

Layout: canonical scenarios/python_{family}/ (main.py, profile.json); *_3.14/*_3.15 symlink expected_profile.json, real Dockerfiles (3.14 PyPI / 3.15 wheel-only). Alloc 3.15 uses separate profile_3.15.json.

3.14 burn-in (CI 32796204349)

Scenario	Expected (±margin)	Observed
alloc samples/space	32/43/29/39 ±5	32–35 / 42–44 / 29 / 39
asyncio wall-time	30/61 ±5	30–31 / 61
native_cpu (×5, cpu+wall)	20 ±5 each	~19–21%
deep_stack cpu-time	99 ±5	98–99%

3.15

All BLOCKED until manylinux cp315 wheel (DDTRACE_INSTALL_URL). Alloc 3.15 profile not re-burned-in.

Test plan

• Schema validation; 3.14 scenarios PASS (burn-in above)
• 3.15 + downstream gate when wheel lands
• CI green on branch tip

[Copilot]

Pull request overview

Adds new Python 3.14/3.15 “stack-advanced” gate scenario families to broaden downstream profiling correctness coverage (alloc, asyncio task labels, native CPU attribution, deep recursive stacks), and updates downstream-gate documentation to include them.

Changes:

• Introduce canonical scenario implementations + profiles for python_alloc, python_asyncio, python_native_cpu, and python_deep_stack.
• Add 3.14 (PyPI install) and 3.15 (wheel-only) scenario wrappers with per-version Dockerfiles/READMEs.
• Expand the documented downstream gate default regexp and scenario set to include the new families.

Reviewed changes

Copilot reviewed 39 out of 39 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
scenarios/python_native_cpu/profile.json	Adds cpu-time and wall-time stack expectations for native CPU attribution workload.
scenarios/python_native_cpu/main.py	Implements native-CPU workload calling C-extension-heavy stdlib functions.
scenarios/python_native_cpu_3.15/README.md	Documents 3.15 wheel-only run instructions for native-cpu scenario.
scenarios/python_native_cpu_3.15/Dockerfile	Defines wheel-only 3.15 image for native-cpu scenario.
scenarios/python_native_cpu_3.14/README.md	Documents 3.14 baseline expectations and local run instructions for native-cpu scenario.
scenarios/python_native_cpu_3.14/Dockerfile	Defines 3.14 image installing requirements for native-cpu scenario.
scenarios/python_deep_stack/profile.json	Adds cpu-time expectation for deep recursive stack + omitted-frames marker.
scenarios/python_deep_stack/main.py	Implements deep recursive stack workload to exercise stack truncation/omission behavior.
scenarios/python_deep_stack_3.15/README.md	Documents 3.15 wheel-only run instructions for deep-stack scenario.
scenarios/python_deep_stack_3.15/Dockerfile	Defines wheel-only 3.15 image for deep-stack scenario.
scenarios/python_deep_stack_3.14/README.md	Documents 3.14 baseline expectations and local run instructions for deep-stack scenario.
scenarios/python_deep_stack_3.14/Dockerfile	Defines 3.14 image installing requirements for deep-stack scenario.
scenarios/python_asyncio/profile.json	Adds wall-time expectations with thread/task-name labels for asyncio tasks.
scenarios/python_asyncio/main.py	Implements asyncio task workload with named and unnamed tasks.
scenarios/python_asyncio_3.15/README.md	Documents 3.15 wheel-only run instructions for asyncio-labels scenario.
scenarios/python_asyncio_3.15/Dockerfile	Defines wheel-only 3.15 image for asyncio-labels scenario (ddtrace-run).
scenarios/python_asyncio_3.14/README.md	Documents 3.14 baseline expectations and local run instructions for asyncio-labels scenario.
scenarios/python_asyncio_3.14/Dockerfile	Defines 3.14 image installing requirements for asyncio-labels scenario (ddtrace-run).
scenarios/python_alloc/profile.json	Adds alloc-samples and alloc-space expectations for 3.14 baseline alloc scenario.
scenarios/python_alloc/profile_3.15.json	Adds separate 3.15 alloc expectations (stack formatting + labels differ).
scenarios/python_alloc/main.py	Implements allocation workload with two allocation sites (1:3 byte ratio).
scenarios/python_alloc_3.15/README.md	Documents 3.15 wheel-only expectations and run instructions for alloc scenario.
scenarios/python_alloc_3.15/Dockerfile	Defines wheel-only 3.15 image for alloc scenario (stack/lock collectors off).
scenarios/python_alloc_3.14/README.md	Documents 3.14 baseline expectations and local run instructions for alloc scenario.
scenarios/python_alloc_3.14/Dockerfile	Defines 3.14 image installing requirements for alloc scenario (stack/lock collectors off).
scenarios/python_downstream_gate/README.md	Updates downstream gate docs/default regexp to include new scenario families.
README.md	Updates downstream workflow input docs for the expanded migration gate.

---

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

[Copilot]

Pull request overview

Copilot reviewed 39 out of 39 changed files in this pull request and generated 1 comment.

Suppressed comments (1)

Previously missed (1) — in code that hasn't changed since the last review.

scenarios/python_native_cpu/main.py:14

• This comment says the data is "shared across workers", but this scenario runs in a single process/thread (no workers are created). Clarifying this avoids confusion when interpreting the scenario’s intent.