Skip to content

flaky tests(s) observed in v26.2.0 #1268

Description

@debtquity

Preflight checklist

Ory Network Project

No response

Describe the bug

I am maintaining the oathkeeper package in NixOS/nixpkgs. I noticed the test suite was not running as part of CI and decided to add it as part of the build process, but I notice these tests appear to be flaky across builds and platforms:

Runs:

x86_64-linux

[1] TestAuthenticatorOAuth2Introspection/method=authenticate-with-cache/case=with_none_scope_strategy/case=second_request_does_use_cache_because_no_scope_was_requested_and_strategy_is_nil

x86_64-darwin

[0,1] TestAuthenticatorOAuth2Introspection/method=authenticate-with-cache/case=with_a_scope_scope_strategy/case=request_succeeds_and_uses_the_cache
[1,2] TestClientCredentialsCache/method=tokenToCache/case=cache_value
[1,2] TestClientCredentialsCache/method=tokenToCache/case=cached_invalid_json_value_should_not_working
[2] TestAuthenticatorOAuth2Introspection/method=authenticate-with-cache/case=with_none_scope_strategy/case=second_request_does_use_cache_because_no_scope_was_requested_and_strategy_is_nil

aarch64-darwin

[0,1,2] TestAuthenticatorOAuth2Introspection/method=authenticate-with-cache/case=with_none_scope_strategy/case=second_request_does_use_cache_because_no_scope_was_requested_and_strategy_is_nil
[0,1] TestAuthenticatorOAuth2Introspection/method=authenticate-with-cache/case=with_a_scope_scope_strategy/case=request_succeeds_and_uses_the_cache
[0] TestClientCredentialsCache/method=tokenToCache/case=cache_value
[0,2] TestClientCredentialsCache/method=tokenToCache/case=cached_invalid_json_value_should_not_working

Reproducing the bug

  1. nixpkgs-review pr 502030

Relevant log output

oathkeeper> ERROR: Access credentials are invalid
oathkeeper>   Request: &{POST /oauth2/token HTTP/1.1 1 1 map[Accept-Encoding:[gzip] Authorization:[Basic Zm9vOmJhcg==] Content-Length:[29] Content-Type:[application/x-www-form-urlencoded] User-Agent:[Go-http-client/1.1]] 0x6e5877fce840 <nil> 29 [] false 127.0.0.1:49421 map[] map[] <nil> map[] 127.0.0.1:49422 /oauth2/token <nil> <nil> <nil>  0x6e5877ecd810 <nil> [] map[]}
oathkeeper>   Response Code: 401
oathkeeper>   Further Info: [An error occurred while handling a request]
oathkeeper> ERROR: The upstream service is not available
oathkeeper>   Request: &{POST /oauth2/token HTTP/1.1 1 1 map[Accept-Encoding:[gzip] Authorization:[Basic Y2xpZW50OnNlY3JldA==] Content-Length:[29] Content-Type:[application/x-www-form-urlencoded] User-Agent:[Go-http-client/1.1]] 0x6e5878db1680 <nil> 29 [] false 127.0.0.1:49466 map[] map[] <nil> map[] 127.0.0.1:49467 /oauth2/token <nil> <nil> <nil>  0x6e5878fe4280 <nil> [] map[]}
oathkeeper>   Response Code: 503
oathkeeper>   Further Info: [An error occurred while handling a request]
oathkeeper> ERROR: The upstream service is timing out
oathkeeper>   Request: &{POST /oauth2/token HTTP/1.1 1 1 map[Accept-Encoding:[gzip] Authorization:[Basic Y2xpZW50OnNlY3JldA==] Content-Length:[29] Content-Type:[application/x-www-form-urlencoded] User-Agent:[Go-http-client/1.1]] 0x6e5878279c40 <nil> 29 [] false 127.0.0.1:49468 map[] map[] <nil> map[] 127.0.0.1:49469 /oauth2/token <nil> <nil> <nil>  0x6e587817fbd0 <nil> [] map[]}
oathkeeper>   Response Code: 504
oathkeeper>   Further Info: [An error occurred while handling a request]
oathkeeper> ERROR: The upstream service encountered an unexpected error
oathkeeper>   Request: &{POST /oauth2/token HTTP/1.1 1 1 map[Accept-Encoding:[gzip] Authorization:[Basic Y2xpZW50OnNlY3JldA==] Content-Length:[29] Content-Type:[application/x-www-form-urlencoded] User-Agent:[Go-http-client/1.1]] 0x6e58791a2040 <nil> 29 [] false 127.0.0.1:49470 map[] map[] <nil> map[] 127.0.0.1:49471 /oauth2/token <nil> <nil> <nil>  0x6e5878fe4820 <nil> [] map[]}
oathkeeper>   Response Code: 500
oathkeeper>   Further Info: [An error occurred while handling a request]
oathkeeper> ERROR: Access credentials are not sufficient to access this resource
oathkeeper>   Request: &{POST /oauth2/token HTTP/1.1 1 1 map[Accept-Encoding:[gzip] Authorization:[Basic Y2xpZW50OnNlY3JldA==] Content-Length:[29] Content-Type:[application/x-www-form-urlencoded] User-Agent:[Go-http-client/1.1]] 0x6e58790c0980 <nil> 29 [] false 127.0.0.1:49474 map[] map[] <nil> map[] 127.0.0.1:49475 /oauth2/token <nil> <nil> <nil>  0x6e587922a410 <nil> [] map[]}
oathkeeper>   Response Code: 403
oathkeeper>   Further Info: [An error occurred while handling a request]

Relevant configuration

Version

v26.2.0

On which operating system are you observing this issue?

Other

In which environment are you deploying?

Binary

Additional Context

NixOS/nixpkgs#502030

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething is not working.

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions