Add InferenceService lifecycle state#612
Open
kartikkhurana1898 wants to merge 2 commits into
Open
Conversation
kartikkhurana1898
requested review from
CatherineSue,
XinyueZhang369,
YouNeedCryDear,
beiguo218,
pallasathena92 and
slin1237
as code owners
github-actions
Bot
added
api
ankrovv
pushed a commit
to ankrovv/ome
that referenced
this pull request
Jun 24, 2026
…-fp8-dynamic InferenceService
Merge in GENAICORE/ome from llama3.3-70bfp8_runtime to main
Squashed commit of the following:
commit d6956eb3884d5cd89feacf3a00f9429d6b892e95
Author: Sachin Goyal <sachin.g.goyal@oracle.com>
Date: Mon Jun 23 10:28:50 2025 +0530
fix llama3-3-70b-instruct-fp8-dynamic isvc
commit a7ddb3e19e5a0524ba81cf46757f3ddbc90772d7
Author: SAADALAM <saad.alam@oracle.com>
Date: Mon Jun 9 19:31:08 2025 +0530
removed pull-request from releaseBranch
commit bec4a841a9b299d35442aaa25f77506de6c407ef
Author: SAADALAM <saad.alam@oracle.com>
Date: Mon Jun 9 16:54:08 2025 +0530
Added the llama 3.3-70b fp8 ondemand runtime
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a high-level
status.lifecycleStatefield toInferenceService.The field is derived from existing Kubernetes/OME status signals:
Readyconditionstatus.modelStatus.transitionStatusstatus.modelStatus.lastFailureInfolifecycleStateMotivation
InferenceServicealready exposes detailed conditions and model transition state, but integrations often need a simple lifecycle summary without reimplementing the condition/status interpretation logic. This adds that summary while keeping the source of truth in existing OME status fields.State Mapping
DELETINGInvalidSpec,BlockedByFailedLoad, orlastFailureInfo) ->FAILEDREADYCREATINGUPDATINGReady=Falseand no progress ->FAILEDCREATINGTesting
go test ./pkg/controller/v1beta1/inferenceservice/status ./pkg/apis/ome/v1beta1go test ./pkg/controller/v1beta1/inferenceservice -run '^$'make manifestsmake generate