Skip to content

Ralph/alp log querying benchmark #53105

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
rhy988 wants to merge 12 commits into from
Closed

Ralph/alp log querying benchmark #53105

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
161c64a
feat(logs): add OTTL-based log processing rules
rhy988 Jun 9, 2026
b1af4e1
feat(logs): add fastjq-based log filtering processing rules
rhy988 Jun 23, 2026
99c6099
chore: go-mod-tidy after removing VRL, keeping OTTL and jq only
rhy988 Jul 1, 2026
07d7c42
chore: second go-mod-tidy pass to settle transitive dependencies
rhy988 Jul 1, 2026
f2c0870
fix: locally patch coreinternal to disable a cgo file that breaks x64…
rhy988 Jul 2, 2026
4032821
fix(tasks): handle ignored modules in get_modified_packages
rhy988 Jul 2, 2026
91cce45
fix: shorten otel-patches directory name to satisfy filename-length lint
rhy988 Jul 2, 2026
f1fabfc
test(regression): add SMP cases for baseline/OTTL/jq log filtering co…
rhy988 Jul 5, 2026
ce4a5ce
chore: go-mod-tidy after rebasing onto latest main
rhy988 Jul 6, 2026
00ae891
test(regression): add apache_common diagnostic case for SMP crash iso…
rhy988 Jul 6, 2026
8a57d29
fix(regression): use built-in json variant + seed filters for log-fil…
rhy988 Jul 6, 2026
fa521b6
Merge remote-tracking branch 'origin/main' into ralph/alp-log-queryin…
rhy988 Jul 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 34 additions & 1 deletion comp/core/agenttelemetry/fx/go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
module github.com/DataDog/datadog-agent/comp/core/agenttelemetry/fx

go 1.25.0
go 1.25.4

require (
github.com/DataDog/datadog-agent/comp/core/agenttelemetry/def v0.0.0
Expand Down Expand Up @@ -56,22 +56,42 @@ require (
github.com/DataDog/datadog-agent/pkg/util/uuid v0.69.4 // indirect
github.com/DataDog/datadog-agent/pkg/util/winutil v0.77.0 // indirect
github.com/DataDog/datadog-agent/pkg/version v0.77.0 // indirect
github.com/DataDog/fastjq v0.0.0-20260506145947-c3336f252fa2 // indirect
github.com/DataDog/go-acl v1.0.1 // indirect
github.com/DataDog/zstd v1.5.8-0.20260421145859-31a7e515a571 // indirect
github.com/Microsoft/go-winio v0.6.2 // indirect
github.com/alecthomas/participle/v2 v2.1.4 // indirect
github.com/antchfx/xmlquery v1.5.1 // indirect
github.com/antchfx/xpath v1.3.6 // indirect
github.com/beorn7/perks v1.0.1 // indirect
github.com/cespare/xxhash/v2 v2.3.0 // indirect
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
github.com/ebitengine/purego v0.10.0 // indirect
github.com/elastic/go-grok v0.3.1 // indirect
github.com/elastic/lunes v0.2.2 // indirect
github.com/go-ole/go-ole v1.3.0 // indirect
github.com/go-viper/mapstructure/v2 v2.5.0 // indirect
github.com/gobwas/glob v0.2.3 // indirect
github.com/goccy/go-json v0.10.6 // indirect
github.com/gofrs/flock v0.13.0 // indirect
github.com/golang/groupcache v0.0.0-20241129210726-2c02b8208cf8 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/hashicorp/go-version v1.9.0 // indirect
github.com/hashicorp/golang-lru v1.0.2 // indirect
github.com/iancoleman/strcase v0.3.0 // indirect
github.com/inconshreveable/mousetrap v1.1.0 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/klauspost/cpuid/v2 v2.3.0 // indirect
github.com/lufia/plan9stats v0.0.0-20260330125221-c963978e514e // indirect
github.com/magefile/mage v1.15.0 // indirect
github.com/mdlayher/socket v0.6.0 // indirect
github.com/mdlayher/vsock v1.3.0 // indirect
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.3-0.20250322232337-35a7c28c31ee // indirect
github.com/mohae/deepcopy v0.0.0-20170929034955-c48cc78d4826 // indirect
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 // indirect
github.com/open-telemetry/opentelemetry-collector-contrib/internal/coreinternal v0.155.0 // indirect
github.com/open-telemetry/opentelemetry-collector-contrib/pkg/ottl v0.155.0 // indirect
github.com/patrickmn/go-cache v2.1.0+incompatible // indirect
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
github.com/power-devops/perfstat v0.0.0-20240221224432-82ca36839d55 // indirect
Expand All @@ -88,19 +108,32 @@ require (
github.com/stretchr/testify v1.11.1 // indirect
github.com/tklauser/go-sysconf v0.3.16 // indirect
github.com/tklauser/numcpus v0.11.0 // indirect
github.com/twmb/murmur3 v1.1.8 // indirect
github.com/ua-parser/uap-go v0.0.0-20251207011819-db9adb27a0b8 // indirect
github.com/yusufpapurcu/wmi v1.2.4 // indirect
github.com/zeebo/xxh3 v1.1.0 // indirect
go.opentelemetry.io/collector/client v1.61.0 // indirect
go.opentelemetry.io/collector/component v1.61.0 // indirect
go.opentelemetry.io/collector/featuregate v1.61.0 // indirect
go.opentelemetry.io/collector/pdata v1.61.0 // indirect
go.opentelemetry.io/collector/pdata/pprofile v0.155.0 // indirect
go.opentelemetry.io/otel v1.44.0 // indirect
go.opentelemetry.io/otel/metric v1.44.0 // indirect
go.opentelemetry.io/otel/trace v1.44.0 // indirect
go.uber.org/atomic v1.11.0 // indirect
go.uber.org/dig v1.19.0 // indirect
go.uber.org/fx v1.24.0 // indirect
go.uber.org/multierr v1.11.0 // indirect
go.uber.org/zap v1.28.0 // indirect
go.yaml.in/yaml/v2 v2.4.4 // indirect
go.yaml.in/yaml/v3 v3.0.4 // indirect
golang.org/x/exp v0.0.0-20260529124908-c761662dc8c9 // indirect
golang.org/x/net v0.56.0 // indirect
golang.org/x/sync v0.21.0 // indirect
golang.org/x/sys v0.46.0 // indirect
golang.org/x/text v0.38.0 // indirect
golang.org/x/time v0.15.0 // indirect
google.golang.org/grpc v1.81.1 // indirect
google.golang.org/protobuf v1.36.12-0.20260116114154-8c4c4ae446ca // indirect
)

Expand Down
170 changes: 170 additions & 0 deletions comp/core/agenttelemetry/fx/go.sum
View file
Open in desktop

Large diffs are not rendered by default.

35 changes: 34 additions & 1 deletion comp/core/agenttelemetry/impl/go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
module github.com/DataDog/datadog-agent/comp/core/agenttelemetry/impl

go 1.25.0
go 1.25.4

require (
github.com/DataDog/datadog-agent/comp/api/api/def v0.72.0-rc.1
Expand Down Expand Up @@ -63,23 +63,43 @@ require (
github.com/DataDog/datadog-agent/pkg/util/system v0.77.0 // indirect
github.com/DataDog/datadog-agent/pkg/util/uuid v0.69.4 // indirect
github.com/DataDog/datadog-agent/pkg/util/winutil v0.77.0 // indirect
github.com/DataDog/fastjq v0.0.0-20260506145947-c3336f252fa2 // indirect
github.com/DataDog/go-acl v1.0.1 // indirect
github.com/Microsoft/go-winio v0.6.2 // indirect
github.com/alecthomas/participle/v2 v2.1.4 // indirect
github.com/antchfx/xmlquery v1.5.1 // indirect
github.com/antchfx/xpath v1.3.6 // indirect
github.com/beorn7/perks v1.0.1 // indirect
github.com/cespare/xxhash/v2 v2.3.0 // indirect
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
github.com/ebitengine/purego v0.10.0 // indirect
github.com/elastic/go-grok v0.3.1 // indirect
github.com/elastic/lunes v0.2.2 // indirect
github.com/go-ole/go-ole v1.3.0 // indirect
github.com/go-viper/mapstructure/v2 v2.5.0 // indirect
github.com/gobwas/glob v0.2.3 // indirect
github.com/goccy/go-json v0.10.6 // indirect
github.com/gofrs/flock v0.13.0 // indirect
github.com/golang/groupcache v0.0.0-20241129210726-2c02b8208cf8 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/hashicorp/go-version v1.9.0 // indirect
github.com/hashicorp/golang-lru v1.0.2 // indirect
github.com/iancoleman/strcase v0.3.0 // indirect
github.com/inconshreveable/mousetrap v1.1.0 // indirect
github.com/itchyny/gojq v0.12.19 // indirect
github.com/itchyny/timefmt-go v0.1.8 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/klauspost/cpuid/v2 v2.3.0 // indirect
github.com/lufia/plan9stats v0.0.0-20260330125221-c963978e514e // indirect
github.com/magefile/mage v1.15.0 // indirect
github.com/mdlayher/socket v0.6.0 // indirect
github.com/mdlayher/vsock v1.3.0 // indirect
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.3-0.20250322232337-35a7c28c31ee // indirect
github.com/mohae/deepcopy v0.0.0-20170929034955-c48cc78d4826 // indirect
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 // indirect
github.com/open-telemetry/opentelemetry-collector-contrib/internal/coreinternal v0.155.0 // indirect
github.com/open-telemetry/opentelemetry-collector-contrib/pkg/ottl v0.155.0 // indirect
github.com/patrickmn/go-cache v2.1.0+incompatible // indirect
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
github.com/power-devops/perfstat v0.0.0-20240221224432-82ca36839d55 // indirect
Expand All @@ -94,17 +114,30 @@ require (
github.com/stretchr/objx v0.5.3 // indirect
github.com/tklauser/go-sysconf v0.3.16 // indirect
github.com/tklauser/numcpus v0.11.0 // indirect
github.com/twmb/murmur3 v1.1.8 // indirect
github.com/ua-parser/uap-go v0.0.0-20251207011819-db9adb27a0b8 // indirect
github.com/yusufpapurcu/wmi v1.2.4 // indirect
github.com/zeebo/xxh3 v1.1.0 // indirect
go.opentelemetry.io/collector/client v1.61.0 // indirect
go.opentelemetry.io/collector/component v1.61.0 // indirect
go.opentelemetry.io/collector/featuregate v1.61.0 // indirect
go.opentelemetry.io/collector/pdata v1.61.0 // indirect
go.opentelemetry.io/collector/pdata/pprofile v0.155.0 // indirect
go.opentelemetry.io/otel v1.44.0 // indirect
go.opentelemetry.io/otel/metric v1.44.0 // indirect
go.opentelemetry.io/otel/trace v1.44.0 // indirect
go.uber.org/dig v1.19.0 // indirect
go.uber.org/fx v1.24.0 // indirect
go.uber.org/multierr v1.11.0 // indirect
go.uber.org/zap v1.28.0 // indirect
go.yaml.in/yaml/v3 v3.0.4 // indirect
golang.org/x/exp v0.0.0-20260529124908-c761662dc8c9 // indirect
golang.org/x/net v0.56.0 // indirect
golang.org/x/sync v0.21.0 // indirect
golang.org/x/sys v0.46.0 // indirect
golang.org/x/text v0.38.0 // indirect
golang.org/x/time v0.15.0 // indirect
google.golang.org/grpc v1.81.1 // indirect
google.golang.org/protobuf v1.36.12-0.20260116114154-8c4c4ae446ca // indirect
)

Expand Down
Loading
Loading