fix image build not using cache #559

fulminemizzega · 2025-06-20T15:02:10Z

This commit fixes issue #528 by adding a default value to parameters layers and outputformat. This change aligns the behavior with podman-remote.

@inknos take a look, I've also added a test for this PR

inknos · 2025-06-23T11:31:05Z

/packit retest-failed

inknos

thanks @fulminemizzega for this PR. please address my comments and we'll move forward :) also don't hesitate to ask questions or raise concerns

inknos · 2025-06-23T11:34:30Z

podman/domain/images_build.py

+        def default(value, def_value):
+            return def_value if value is None else value


having a function for this is overkill, parameters can be defined as default in kwargs calls.

consider using kwargs.get(value, default) like here

I did not know of this. Makes more sense

This should be ok now. I'm a bit on the fence on this, I started thinking about using an enum type for the outputformat parameter, so I've played a bit with the code in another branch in my fork and removed all the kwargs thing and moved all the keys to function parameters, with type annotations and default values. Why do so many functions in this project use kwargs and a _render_param function? Is this something that could be useful or is it better if I leave it alone?

Why do so many functions in this project use kwargs

Historical reasons probably?

@jwhonce might give us a good answer

@fulminemizzega kwargs was a good escape hatch for podman-py to ease the migration for scripts from docker-py. It allowed developers access to podman features without having to port their whole scripts. From there I suspect there are areas where new development followed the old form even if it didn't make as much sense.

The flexibility of args / kwargs have always been very Pythonic and pre-date type hinting.

I see, thanks for your answer. Would there be any value in a PR for moving most of the kwargs to typed parameters for at least images.build? I've tried to do it but my changes do break existing code (I made all the strings that are used for paths become a pathlib.Path, so the argument has to be Path("something") instead of just "something").

podman/domain/images_build.py

inknos · 2025-06-23T11:38:29Z

podman/tests/integration/test_images.py

        self.assertIsNotNone(image)
        self.assertIsNotNone(image.id)

+    def test_build_cache(self):


more tests are probably needed to ensure that the defaults are passed, and images.build also accepts the other parameters

There are defaults like those above, and then there is dockerfile that is generated randomly... maybe this is something that should be done in a unit test?

There are defaults like those above, and then there is dockerfile that is generated randomly... maybe this is something that should be done in a unit test?

I think you can do all through integration tests by inspecting the request that are passed. if you want I can write you some pseudo-code to help understand how I would design it

Yes please, I’m not familiar with this kind of stuff… how would I inspect what is requested? I’ve seen how it is mocked in unit tests, is it related?

Yes please, I’m not familiar with this kind of stuff… how would I inspect what is requested? I’ve seen how it is mocked in unit tests, is it related?

Actually my bad, I was looking into many things at the same time and got confused. You are correct, unit tests is the place where you check you function. Also yes, you said it right, you need to mock a request and test that your image build calls the parameters correctly in the default/non-default cases.

more tests are probably needed to ensure that the defaults are passed, and images.build also accepts the other parameters

About the other parameters, you mean that, besides the new defaults, there should be a test should that uses all of them and inspects the request? In that case, there is another issue: while experimenting with the parameter-argument conversion (see above), I discovered that _render_params parses the "remote" key, it is not documented, it can not be used alone because _render_params requires either "path" or "fileobj" (and both are meaningless if remote is used), but other than that the build function is able to handle this, because body is initialized with None, and when all the if/elif fail it stays None which is right for remote. But if dockerfile is None, then it is generated randomly in _render_params and this will be yet another issue: "If the URI points to a tarball and the dockerfile parameter is also specified, there must be a file with the corresponding path inside the tarball" from https://docs.podman.io/en/latest/_static/api.html#tag/images/operation/ImageBuildLibpod
I understand this is going quite out of the "cache" issue scope, I apologize in advance.

I've added a unit test that checks the default parameters for images.build, with it also I corrected the mock URL for two other test cases

Honny1

Thanks, LGTM. Just one nonblocking nit.

Honny1 · 2025-09-24T09:08:32Z

podman/tests/integration/test_images.py


+    def test_build_cache(self):
+        """Check that building twice the same image uses caching"""
+        buffer = io.StringIO("""FROM quay.io/libpod/alpine_labels:latest\nLABEL test=value""")


You can use FROM scratch so you don't rely on an external image. (This is nonblocking)

Suggested change

buffer = io.StringIO("""FROM quay.io/libpod/alpine_labels:latest\nLABEL test=value""")

buffer = io.StringIO("""FROM scratch\nLABEL test=value""")

I've followed your advice and also applied it in test_build

Honny1 · 2025-09-24T09:16:51Z

/packit retest-failed

inknos · 2025-09-25T10:18:57Z

/packit build

This commit fixes issue containers#528 by adding a default value to parameters layers and outputformat. This change aligns the behavior with podman-remote. Signed-off-by: Federico Rizzo <[email protected]>

Signed-off-by: Federico Rizzo <[email protected]>

Replace function "default" inside _render_params in images_build.py with dict.get (kwargs.get) default value. Signed-off-by: Federico Rizzo <[email protected]>

Signed-off-by: Federico Rizzo <[email protected]>

Avoid using external images in test_build and test_build_cache, check both build caching both enabled and disabled. Signed-off-by: Federico Rizzo <[email protected]>

Honny1 · 2025-11-24T11:53:46Z

/packit retest-failed

Honny1 · 2025-11-24T12:11:32Z

It seems like there is an issue with the tests. Any ideas? @inknos @fulminemizzega

=================================== FAILURES ===================================
____________________ ImagesIntegrationTest.test_image_crud _____________________

self = <podman.tests.integration.test_images.ImagesIntegrationTest testMethod=test_image_crud>

    def test_image_crud(self):
        """Test Image CRUD.
    
        Notes:
            Written to maximize reuse of pulled image.
        """
    
        with self.subTest("Pull Alpine Image"):
            image = self.client.images.pull("quay.io/libpod/alpine", tag="latest")
            self.assertIsInstance(image, Image)
            self.assertIn("quay.io/libpod/alpine:latest", image.tags)
            self.assertTrue(self.client.images.exists(image.id))
    
        with self.subTest("Inspect Alpine Image"):
            image = self.client.images.get("quay.io/libpod/alpine")
            self.assertIsInstance(image, Image)
            self.assertIn("quay.io/libpod/alpine:latest", image.tags)
    
        with self.subTest("Retrieve Image history"):
            ids = [i["Id"] for i in image.history()]
>           self.assertIn(image.id, ids)
E           AssertionError: '961769676411f082461f9ef46626dd7a2d1e2b2a38e6a44364bcbecf51e66dd4' not found in ['f88416a00aabae4c9520ee61e1692b50faf551e0d08e2196b736a9e0e63ad060', '<missing>']

podman/tests/integration/test_images.py:69: AssertionError

fulminemizzega · 2025-11-24T13:39:56Z

It seems like there is an issue with the tests. Any ideas? @inknos @fulminemizzega

For this sub case I still do not have any idea. I have had it working in 2 different systems, after resetting my podman environment (with podman system reset, since they've deprecated the boltDB db without any migration tool). Before resetting it I also had this test failing, and now I've just checked, it would fail again. I really have no idea why the libpod/alpine image's history does not contain the id of the image itself.
Just to be sure, I've run again podman system reset, and now after a pull I get:

# podman history libpod/alpine
ID            CREATED      CREATED BY                                     SIZE        COMMENT
961769676411  6 years ago  /bin/sh -c #(nop)  CMD ["/bin/sh"]             0B
<missing>     6 years ago  /bin/sh -c #(nop) ADD file:fe64057fbb83dcc...  5.84MB

which is ok.
On another system it is:

$ podman history libpod/alpine
ID            CREATED      CREATED BY                                     SIZE        COMMENT
d054a073bda4  6 years ago  /bin/sh -c #(nop)  CMD ["/bin/sh"]             0B
<missing>     6 years ago  /bin/sh -c #(nop) ADD file:fe64057fbb83dcc...  5.84MB

There is another failing test where I have a theory, and it is related to caching: subtest "Deleted unused Images" in test_images.py:test_image_crud (line 112) will fail because test_containers.py:test_container_commit leaves behind an image built from libpod/alpine. When the sub test tries to delete all the unused images it fails because the libpod/alpine image is in use by the new localhost/busybox.local:unittest.
I did not catch this because I do not run all the tests on my dev machine since it destroys all running containers... but the image history test case is a mistery.

fulminemizzega · 2025-11-25T10:08:19Z

Disregard what I've written yesterday. The issue is related to caching and an intermediary image left over by test_containers.py:test_container_rm_anonymous_volume. This and some other steps performed in test_images.py are enough to explain everything, I think. I want to reproduce the steps with just podman and see if the results are the same.

Remove image left by integration test test_containers.py:test_container_rm_anonymous_volume. When caching is enabled, an intermediary image generated by the build function call (corresponding to layer created by "VOLUME myvol", see container_file string defined in the first lines of the function test_container_rm_anonymous_volume) breaks test_images.py:test_image_crud sub-test "Delete Image", where the same base image (quay.io/libpod/alpine:latest) is supposed to be removed, but is instead untagged, as it is in "use" by the other layers. This also breaks sub-test "Delete unused Images" and on on successive runs "Retrieve Image history". Signed-off-by: Federico Rizzo <[email protected]>

fulminemizzega · 2025-11-26T21:04:36Z

I have written most of the details in the last commit, I do not know if how I solved it is reasonable. I think that the cleanup should happen even if test_containers.py:test_container_rm_anonymous_volume fails, otherwise if this test fails leaving behind the built image, then the same tests in test_images.py will fail. On the other hand, the tested behavior (podman deleting anonymous volumes) is not really a concern of podman-py...

Honny1 · 2025-11-27T12:52:52Z

/packit rebuild-failed

Honny1

Thanks for the comprehensive investigation. LGTM

openshift-ci · 2025-11-27T15:08:30Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fulminemizzega, Honny1
Once this PR has been reviewed and has the lgtm label, please assign mheon for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Honny1 · 2025-11-27T15:10:57Z

PTAL @inknos

fulminemizzega · 2025-11-29T17:28:37Z

I've investigated a bit the pre-commit failing check, the tmt lint step reports an error. I can reproduce it using python 3.14 and tmt 1.39, it works fine with python 3.13. If it is not an issue, updating tmt to the latest version in .pre-commit-config.yaml (I tested 1.62.1 with python 3.14.0) fixes it.

fulminemizzega force-pushed the main branch from dfdc36c to 8864814 Compare June 21, 2025 00:12

inknos self-requested a review June 23, 2025 11:31

inknos requested changes Jun 23, 2025

View reviewed changes

fulminemizzega force-pushed the main branch from 8864814 to 512c861 Compare June 23, 2025 16:49

Honny1 reviewed Sep 24, 2025

View reviewed changes

openshift-merge-robot added the needs-rebase label Nov 17, 2025

fulminemizzega added 5 commits November 23, 2025 05:47

fix image build not using cache

2c3de4f

This commit fixes issue containers#528 by adding a default value to parameters layers and outputformat. This change aligns the behavior with podman-remote. Signed-off-by: Federico Rizzo <[email protected]>

document new defaults in images_build.py

1ca9db9

Signed-off-by: Federico Rizzo <[email protected]>

use kwargs.get default parameter for defaults

3ea9d2e

Replace function "default" inside _render_params in images_build.py with dict.get (kwargs.get) default value. Signed-off-by: Federico Rizzo <[email protected]>

fix wrong mock URL in test_build unit test

4b2b283

Signed-off-by: Federico Rizzo <[email protected]>

add unit test for images.build default parameters

289f769

Signed-off-by: Federico Rizzo <[email protected]>

fulminemizzega force-pushed the main branch from b623793 to c754377 Compare November 23, 2025 05:01

openshift-merge-robot removed the needs-rebase label Nov 23, 2025

fulminemizzega force-pushed the main branch from c754377 to 53e9792 Compare November 23, 2025 05:05

minor improvements to test_images integration test

9a36fb8

Avoid using external images in test_build and test_build_cache, check both build caching both enabled and disabled. Signed-off-by: Federico Rizzo <[email protected]>

fulminemizzega force-pushed the main branch from 53e9792 to a1e5316 Compare November 26, 2025 20:17

Honny1 approved these changes Nov 27, 2025

View reviewed changes

fulminemizzega deployed to build November 27, 2025 15:08 — with GitHub Actions Active

		def default(value, def_value):
		return def_value if value is None else value

	buffer = io.StringIO("""FROM quay.io/libpod/alpine_labels:latest\nLABEL test=value""")
	buffer = io.StringIO("""FROM scratch\nLABEL test=value""")

fix image build not using cache #559

Are you sure you want to change the base?

fix image build not using cache #559

Uh oh!

Conversation

fulminemizzega commented Jun 20, 2025

Uh oh!

inknos commented Jun 23, 2025

Uh oh!

inknos left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Honny1 left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Honny1 commented Sep 24, 2025

Uh oh!

inknos commented Sep 25, 2025

Uh oh!

Honny1 commented Nov 24, 2025

Uh oh!

Honny1 commented Nov 24, 2025

Uh oh!

fulminemizzega commented Nov 24, 2025

Uh oh!

fulminemizzega commented Nov 25, 2025

Uh oh!

fulminemizzega commented Nov 26, 2025

Uh oh!

Honny1 commented Nov 27, 2025

Uh oh!

Honny1 left a comment

Choose a reason for hiding this comment

Uh oh!

openshift-ci bot commented Nov 27, 2025

Uh oh!

Honny1 commented Nov 27, 2025

Uh oh!

fulminemizzega commented Nov 29, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants