Skip to content

adding progress bar for asyncio operations#674

Open
debasisdwivedy wants to merge 1 commit intoflyteorg:mainfrom
debasisdwivedy:add_tqdm_for_async_operation
Open

adding progress bar for asyncio operations#674
debasisdwivedy wants to merge 1 commit intoflyteorg:mainfrom
debasisdwivedy:add_tqdm_for_async_operation

Conversation

@debasisdwivedy
Copy link
Contributor

Hi,

Adding progress bars using tqdm package for asynchronous operations

Signed-off-by: debasisdwivedy <dwivedy.debasis@gmail.com>
@kumare3
Copy link
Contributor

kumare3 commented Feb 15, 2026

Thank you, but this is a hard one to take as it introduces new dependencies and not sure if plays well, with runtime and cli

"aiolimiter>=1.2.1",
"flyteidl2==2.0.2",
"packaging",
"tqdm>=4.67.3",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Really prefer if you use rich progress if at all. No new dependencies please

uploaded_files.append(_upload_single_file(cfg, file, verify=verify, basedir=prefix))

urls = await asyncio.gather(*uploaded_files)
urls = await tqdm.gather(*uploaded_files,desc=f"Uploading files to {dir_path}")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rendering this becomes a big challenge - we need to think about the rendering and overhead architecture of runtime vs cli

@debasisdwivedy
Copy link
Contributor Author

Agreed. Let's keep this PR open till we figure out the best way todo it.
We dont want users to wait and know how long to wait for the tasks. There is an example usage in this PR as well but i want it to be included in the sdk so the user does not have to bother writing it.

We can also look into rich-progress bar. I have not used it though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants