Skip to content

Fix model offloading and training tests + prevent examples timeout (#… #5640

Fix model offloading and training tests + prevent examples timeout (#…

Fix model offloading and training tests + prevent examples timeout (#… #5640

Triggered via push July 4, 2026 03:02
Status Failure
Total duration 2h 1m 22s
Artifacts 38

push_tests.yml

on: push
Setup Torch Pipelines CUDA Slow Tests Matrix
1m 3s
Setup Torch Pipelines CUDA Slow Tests Matrix
PyTorch Compile CUDA tests
47m 58s
PyTorch Compile CUDA tests
PyTorch xformers CUDA tests
7m 0s
PyTorch xformers CUDA tests
Examples PyTorch CUDA tests on Ubuntu
46m 45s
Examples PyTorch CUDA tests on Ubuntu
Matrix: Torch CUDA Tests
Matrix: Torch Pipelines CUDA Tests
Fit to window
Zoom out
Zoom in

Annotations

21 errors
Torch Pipelines CUDA Tests (controlnet_sd3)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (ernie_image)
Process completed with exit code 5.
Torch Pipelines CUDA Tests (chroma)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (controlnet_flux)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (ideogram4)
Process completed with exit code 5.
Torch Pipelines CUDA Tests (hidream_image)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (hunyuan_video)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (latent_consistency_models)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (ltx)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (marigold)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (controlnet)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (stable_diffusion_3)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (stable_diffusion_2)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (stable_diffusion)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (stable_video_diffusion)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (text_to_video_synthesis)
Process completed with exit code 5.
Torch Pipelines CUDA Tests (stable_diffusion_xl)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (qwenimage)
Process completed with exit code 1.
Torch Pipelines CUDA Tests (wan)
Process completed with exit code 1.
PyTorch Compile CUDA tests
Process completed with exit code 1.
Torch CUDA Tests (models)
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size Digest
examples_test_reports
7.58 KB
sha256:8cd301e8268a72221055020e92603cc2f3cd197a5168439a69d2c9a168b8264a
pipeline_aura_flow_test_reports
5.58 KB
sha256:e5f7435969c24b93b5c90b3629a02c2f4433a29d56d4dc5ff3b971c6e8fbc337
pipeline_chroma_test_reports
11.2 KB
sha256:da047dbdd80457780397533c485c7afd200a34be503f72a205490be66713fc8e
pipeline_controlnet_flux_test_reports
15 KB
sha256:0083f748e73134d85cc0cf1fd776d19818f78ecb7975cdba0b9a386243945780
pipeline_controlnet_sd3_test_reports
16.7 KB
sha256:e6847d164e816805a796e175dce186f703a085e002a1bd35b259f19e6a3625cd
pipeline_controlnet_test_reports
59.4 KB
sha256:a2f471a63b115b0da9f8a264e7b0605f015b7e7ffd1013613c9482cba73a6e1d
pipeline_ddpm_test_reports
2.04 KB
sha256:91674cef4355dac3c9617c45720e01accca5567a9703d3c0fb5205fd29bfc966
pipeline_ernie_image_test_reports
1.5 KB
sha256:f6d4ccb059971999e5a60b5adb916476c0e6213d8ad7e62ef8ac22e03520ce1d
pipeline_flux2_test_reports
9.1 KB
sha256:fce946f6fbd2c3083fd6ba3b34c14b929332fbd1c39e55b0c1f759e6338605ec
pipeline_flux_test_reports
25.3 KB
sha256:4bf2ead68c76289f9e1f9d58753c1b69e91c98f3e2bad35f9bc804bd414342f5
pipeline_hidream_image_test_reports
8.55 KB
sha256:56c28f0a5d804d00f424c88236750b4db91f70fb4ea836abb93b7160f38dc6cc
pipeline_hunyuan_video_test_reports
30.1 KB
sha256:47db5e0c4176f4b775e964c137f14f997307e1996f5c7d2c7a68ba9ae887d4ee
pipeline_hunyuandit_test_reports
6.47 KB
sha256:87b76ac5e346210f82b5c4343ab83ee262c409c1ea9ac2c535ca6b347cbcf7f7
pipeline_ideogram4_test_reports
1.47 KB
sha256:0c4073be4e4bfa1a9548db3446e06b113136141967ebdb32974ab5ab466f1e6c
pipeline_ip_adapters_test_reports
2.1 KB
sha256:2c2276499c33e659191fb9bdc57d782797d9308bfac7bf5692abac82d29e3db7
pipeline_krea2_test_reports
5.23 KB
sha256:0a3f97c8926621c3112baed63c5614af5280e01184ce59df1499b514808b3467
pipeline_latent_consistency_models_test_reports
15.9 KB
sha256:a1901bff65d78d97b75c2b3149b30fb6cf3d76b25ff3ca591dae519520d14436
pipeline_ltx_test_reports
11.4 KB
sha256:5754d2fb3275ecc3cf69e57f0c145b0183fc9d76c1d010eba0b5bd27f3943f6f
pipeline_marigold_test_reports
12.4 KB
sha256:e92eb4ec4059bb828019b4748c0f9c5ce2358fce1bdff8c38211d863008c3413
pipeline_qwenimage_test_reports
19.8 KB
sha256:818b4f514f4189f7ccd3a57fbce5d2ae19903033072f721ce5059d4b02dea6dd
pipeline_sana_test_reports
9.27 KB
sha256:e007c7ff7a91c4f660dc857bbbf5cbbceca8bd2f566c3223f505131dc6ca3741
pipeline_stable_diffusion_2_test_reports
35.9 KB
sha256:b81ad689deb3a3f7ed254234604cfcf87c78ce7ed17531ac785b3b8baaf9a9f3
pipeline_stable_diffusion_3_test_reports
15.1 KB
sha256:490077851246c3c0d1e4899c6a342ff17cf21040a5f86ad5fd11d20287c17600
pipeline_stable_diffusion_test_reports
45.1 KB
sha256:4b8bef071c206ecb95869b3b989157a3bcd8f3d3eb1289ee0d351c55fdea2838
pipeline_stable_diffusion_xl_test_reports
41.6 KB
sha256:4e8155fbf1c40416101760a4dfe1b86cf65bbac9fe8e62dd3f4797a9a0a686a2
pipeline_stable_video_diffusion_test_reports
6.6 KB
sha256:174716623584a51ead7a6e14aea3db1f049188f9fe04329e8cf86fb486258254
pipeline_text_to_video_synthesis_test_reports
1.69 KB
sha256:6e89345ef83360538013532a3939ef5034fbaf9d32b1529285858c6cd6c7dc08
pipeline_wan_test_reports
21.5 KB
sha256:4196de0940aa738a7ffa885bcdfaf4a25ea74a52833600148569f2095edd6a53
pipeline_z_image_test_reports
7.25 KB
sha256:523c9fc8f1fd6785611aab7325800f98962169573ecd72c4efd48b0b0c07ecc1
test-pipelines.json
369 Bytes
sha256:d3d13adb4b102457d5029104c312002e5496650c482778f6bcb7dbfa58c0ad5b
torch_compile_test_reports
162 KB
sha256:01ae695cbbbab15dbf4ee12bf00c3a447594e28df7b1016416ea9cc0cab9d4c9
torch_cuda_test_reports_hooks
3.93 KB
sha256:fdcc977245e3979415ee1c460a8a0b00d014a82548ed13e7686676e4d6a9a690
torch_cuda_test_reports_lora
76.5 KB
sha256:d4f9fb7dc251ca1b6a910666b27cfa6ab017388dddd613e22794ddfebf165644
torch_cuda_test_reports_models
266 KB
sha256:d42343bd145eba7591da00272be0e96958fc876c396f825583d572e9f00f29d4
torch_cuda_test_reports_others
6.86 KB
sha256:912585b01ba576b8e6d791b9cea39a0e461e08927ea9ad5e361b07aa95653319
torch_cuda_test_reports_schedulers
15.1 KB
sha256:4fca69468f975638b17c2172a81f39c89c9f94589815e9c793d945b82a052461
torch_cuda_test_reports_single_file
2.43 KB
sha256:a6850ec83ca8a865c8d0e94d57bd37610a6fb8c5712edea061ae060912e159d3
torch_xformers_test_reports
12.9 KB
sha256:bda7c2ec1c169e49b0f1ed98220308d08779cc5028df0ff7d95febef2cf686f6