Skip to content

Conversation

@simshi
Copy link

@simshi simshi commented Nov 21, 2025

Purpose

What this PR does / why we need it?
Add new device support for MACA in ucm/store/device/maca/

Modifications

Modified files

  • setup.py: Update package configuration to include new MACA platform.
  • ucm/shared/trans/CMakeLists.txt: Add reference to the maca subdirectory.
  • ucm/store/device/CMakeLists.txt: Add reference to the maca subdirectory.

Added files

  • ucm/shared/trans/maca/CMakeLists.txt: Build configuration for the MACA platform.
  • ucm/shared/trans/maca/maca_sm_kernel.cu: MACA specific implementation.
  • ucm/store/device/maca/CMakeLists.txt: Build configuration for the MACA platform.
  • ucm/store/device/maca/maca_device.cu: MACA specific implementation.

Test

Tested installation with pip install , used with vLLM

vllm serve ... --block_size 128 --no-enable-prefix-caching --kv-transfer-config '{
         "kv_connector": "UnifiedCacheConnectorV1",
         "kv_connector_module_path": "ucm.integration.vllm.uc_connector",
         "kv_role": "kv_both",
         "kv_connector_extra_config": {
           "ucm_connector_name": "UcmNfsStore",
           "ucm_connector_config": {
             "storage_backends": "/wtest",
             "transferStreamNumber": 16,
             "use_layerwise": false,
             "transferUseDirect" : false
           }
         }
       }'

Test env:

  • maca SDK: 3.0.0.8
  • vllm: 0.9.1 (hacked ucm/integration/vllm/patch/apply_patch.py to support 0.9.1)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant