Skip to content

add remote executor manager - #3082

Open
mehrdad2m wants to merge 23 commits into
mainfrom
add-executor-dispatch
Open

add remote executor manager#3082
mehrdad2m wants to merge 23 commits into
mainfrom
add-executor-dispatch

Conversation

@mehrdad2m

Copy link
Copy Markdown
Contributor

Before submitting

Please complete the following checklist when submitting a PR:

  • All new functions and code must be clearly commented and documented.

  • Ensure that code is properly formatted by running make format.
    The latest version of black and clang-format-20 are used in CI/CD to check formatting.

  • All new features must include a unit test.
    Integration and frontend tests should be added to frontend/test,
    Quantum dialect and MLIR tests should be added to mlir/test, and
    Runtime tests should be added to runtime/tests.

When all the above are checked, delete everything above the dashed
line and fill in the pull request template.


Context:

Description of the Change:

Benefits:

Possible Drawbacks:

Related GitHub Issues:

@multiphaseCFD

Copy link
Copy Markdown
Member

[sc-126328]

@multiphaseCFD
multiphaseCFD marked this pull request as ready for review August 3, 2026 16:43
@codecov

codecov Bot commented Aug 3, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 85.75342% with 104 lines in your changes missing coverage. Please review.
✅ Project coverage is 96.51%. Comparing base (5cd78be) to head (5596346).

Files with missing lines Patch % Lines
frontend/catalyst/executor/manager.py 65.21% 54 Missing and 2 partials ⚠️
frontend/catalyst/executor/process.py 80.59% 36 Missing and 3 partials ⚠️
frontend/catalyst/executor/utils.py 96.80% 3 Missing and 1 partial ⚠️
frontend/catalyst/api_extensions/target.py 97.10% 0 Missing and 2 partials ⚠️
frontend/catalyst/compiler.py 33.33% 1 Missing and 1 partial ⚠️
frontend/catalyst/executor/ssh.py 99.39% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3082      +/-   ##
==========================================
- Coverage   96.92%   96.51%   -0.42%     
==========================================
  Files         166      172       +6     
  Lines       19142    19872     +730     
  Branches     1815     1898      +83     
==========================================
+ Hits        18553    19179     +626     
- Misses        430      524      +94     
- Partials      159      169      +10     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Comment on lines +132 to +142
def _get_backline_dispatch_address(device) -> Optional[str]:
"""Dispatch address for a remote backline controller, sourced from an executor. Defaults to the controller's own ``addr:port``."""
for ex in _get_controller_executors(device):
if _attr(ex, "address"):
return ex.address
ctrl = _get_backline_controller(device)
addr = _attr(ctrl, "addr")
if not addr:
return None
port = _attr(ctrl, "port")
return f"{addr}:{port}" if port else addr

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this shouldn't default to the controller's addr:port, they serve different purpose. The executor address is for orc jit dispatching, but the controller addr/port is for RDMA OOB.

@multiphaseCFD multiphaseCFD Aug 5, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mehrdad2m what would be the recommended default value for jit dispatch?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll update this

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Good catch!

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @josephleekl for the changes they look good on my side

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants