Skip to content

Conversation

@Mayankvlog
Copy link

This PR isolates the fix for the Torch/JIT issue in EfficientNetV2 where the channel formatting caused incorrect shape handling.

Mayankvlog and others added 16 commits October 25, 2025 17:41
- torch-xla is not available for Windows platform
- Manually installed tensorflow-cpu, torch, jax, and flax
- Fixed protobuf version conflicts (downgraded to <6.0.0)
- Tests now run successfully without ModuleNotFoundError
…ng errors

- Fixed custom_gradient in JAX backend to extract Variable values automatically
- Improved code structure by moving helper function outside wrapper
- Fixed EfficientNetV2B2 import to use direct module import
- Fixed all Ruff linting errors (line length, unused imports/variables)
- Tests now pass without requiring manual .value access on Variables
- Changed input size from 64x64 to 224x224 (minimum supported by EfficientNetV2)
- Fixed EfficientNetV2B0 import to use direct module path
- Resolves ValueError: Input size must be at least 32x32
- Resolves ImportError for EfficientNetV2B0
…input_shape validation

This commit addresses three issues that were causing CI failures:

1. Fixed JAX Backend custom_gradient with Variables (Issue keras-team#21105)
   - Problem: Variables passed to custom_gradient in JAX backend caused
     'TypeError: NoneType object is not callable'
   - Root cause: JAX copies Variables during tracing, causing both _value
     and _initializer to become None
   - Solution:
     * Modified custom_gradient wrapper to properly convert Variables to values
     * Added fallback in __jax_array__ to handle uninitialized Variables
   - Added test: test_custom_gradient_with_variable in keras/src/ops/core_test.py

2. Fixed obtain_input_shape validation for channels_first format
   - Problem: Confusing error when users provide input_shape in wrong format
     (e.g., (224,224,3) when (3,224,224) expected for channels_first)
   - Solution: Added validation to detect format mismatch with clear error message
   - Updated efficientnet_v2_jit_test.py to use correct channels_first format

3. Code format fixes
   - Fixed line length violations
   - Fixed import ordering
   - Removed unused imports

Files modified:
- keras/src/backend/jax/core.py
- keras/src/ops/core_test.py
- keras/src/applications/imagenet_utils.py
- keras/src/applications/efficientnet_v2_jit_test.py
- test_custom_gradient_jax_variable.py

All tests passing with JAX backend.
- Changed get_shapes_dict to only exclude 'mask' parameter, not all *_mask
- Allows custom layers to use parameters like attention_mask, padding_mask
- Added comprehensive tests for _mask parameter handling
- Maintains backward compatibility with Keras masking

Fixes keras-team#21154
@gemini-code-assist
Copy link
Contributor

Summary of Changes

Hello @Mayankvlog, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request delivers several key improvements and new features to Keras. It addresses a critical jit_compile compatibility issue with EfficientNetV2 models on the Torch backend, ensuring smoother execution and providing clear guidance on its usage. Furthermore, it enhances the JAX backend by enabling seamless integration of Keras Variable objects with custom_gradient functions. A significant addition is the new LPIPS perceptual loss, offering a robust metric for image similarity. Minor adjustments to layer mask parameter handling and input shape validation also contribute to overall framework stability and usability.

Highlights

  • EfficientNetV2 Torch JIT Compatibility: Resolved an issue preventing EfficientNetV2 models from being jit_compiled successfully on the Torch backend, and added documentation detailing current limitations and workarounds.
  • JAX custom_gradient Variable Support: Enhanced the JAX backend's custom_gradient to correctly handle Keras Variable objects, preventing TypeErrors by automatically converting them to their underlying values.
  • New LPIPS Perceptual Loss: Introduced a new backend-agnostic LPIPS (Learned Perceptual Image Patch Similarity) loss, which uses deep feature activations for image comparison.
  • Refined Layer Mask Parameter Handling: Corrected the logic for Layer's get_shapes_dict to ensure only the explicit mask parameter is excluded, allowing other _mask suffixed parameters to be correctly processed.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces several valuable fixes, including for the EfficientNetV2 JIT issue on the Torch backend, JAX custom gradients with Variables, and layer masking arguments. These changes improve correctness and user experience.

However, this PR bundles multiple unrelated changes and has some critical issues. It adds a new LPIPS loss, which should be in a separate feature PR. It also includes a redundant test script. Most importantly, it deletes the root .gitignore and README.md files, which is a critical error that needs to be reverted.

To maintain a clean and reviewable commit history, I strongly recommend splitting this PR into smaller, focused pull requests for each distinct fix or feature. Please restore the deleted repository files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants