Db v4 move graph folder#2624
Open
arienandalibi wants to merge 28 commits into
Open
Conversation
…icate DIRTY_PATH in raphtory-graphql/src/data.rs
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
⚠️ Performance Alert ⚠️
Possible performance regression was detected for benchmark 'Rust Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 2.
| Benchmark suite | Current: a1f487a | Previous: 9823ef7 | Ratio |
|---|---|---|---|
large/1k random edge additions with numeric string input |
1778101 ns/iter (± 80820) |
876236 ns/iter (± 86855) |
2.03 |
lotr_graph/num_edges |
4 ns/iter (± 0) |
0 ns/iter (± 0) |
+∞ |
lotr_graph/num_nodes |
4 ns/iter (± 0) |
1 ns/iter (± 0) |
4 |
lotr_graph/graph_latest |
3 ns/iter (± 0) |
0 ns/iter (± 0) |
+∞ |
lotr_graph_materialise/materialize |
8648566 ns/iter (± 69709) |
1564816 ns/iter (± 35303) |
5.53 |
lotr_graph_window_100/num_nodes |
13 ns/iter (± 0) |
5 ns/iter (± 0) |
2.60 |
lotr_graph_window_100_materialise/materialize |
8592243 ns/iter (± 101576) |
1669150 ns/iter (± 10700) |
5.15 |
lotr_graph_window_10/has_node_existing |
135 ns/iter (± 10) |
62 ns/iter (± 11) |
2.18 |
lotr_graph_window_10_materialise/materialize |
3505404 ns/iter (± 29581) |
971980 ns/iter (± 4278) |
3.61 |
lotr_graph_subgraph_10pc_materialise/materialize |
2206057 ns/iter (± 22383) |
334634 ns/iter (± 1287) |
6.59 |
lotr_graph_subgraph_10pc_windowed/has_node_existing |
140 ns/iter (± 9) |
62 ns/iter (± 14) |
2.26 |
lotr_graph_subgraph_10pc_windowed_materialise/materialize |
1295694 ns/iter (± 18380) |
230399 ns/iter (± 2617) |
5.62 |
lotr_graph_window_50_layered/num_edges_temporal |
147106 ns/iter (± 3388) |
70121 ns/iter (± 7586) |
2.10 |
lotr_graph_window_50_layered/has_node_existing |
377 ns/iter (± 20) |
129 ns/iter (± 12) |
2.92 |
lotr_graph_window_50_layered/graph_latest |
87482 ns/iter (± 1383) |
36649 ns/iter (± 916) |
2.39 |
lotr_graph_window_50_layered_materialise/materialize |
32704798 ns/iter (± 353017) |
3488825 ns/iter (± 24948) |
9.37 |
lotr_graph_persistent_window_50_layered/num_edges_temporal |
592545 ns/iter (± 5974) |
192686 ns/iter (± 1569) |
3.08 |
lotr_graph_persistent_window_50_layered/has_node_existing |
410 ns/iter (± 376) |
174 ns/iter (± 83) |
2.36 |
lotr_graph_persistent_window_50_layered/graph_latest |
126625 ns/iter (± 3946) |
57549 ns/iter (± 4809) |
2.20 |
lotr_graph_persistent_window_50_layered_materialise/materialize |
59624634 ns/iter (± 861043) |
5298035 ns/iter (± 147912) |
11.25 |
This comment was automatically generated by workflow using github-action-benchmark.
ljeub-pometry
requested changes
Jun 10, 2026
… over. Now, we have many import errors because things from raphtory can't be imported (like GraphError)
…_v4_move_graph_folder
….rs file over. Now, we have many import errors because things from raphtory can't be imported (like GraphError)" This reverts commit 2cab13c.
…build the GraphMetadata in Raphtory
# Conflicts: # raphtory/src/db/graph/views/filter/model/degree_filter.rs
…ata to update metadata instead of previous refresh_disk_graph_metadata.
ljeub-pometry
requested changes
Jun 19, 2026
ljeub-pometry
left a comment
ljeub-pometry
left a comment
Collaborator
There was a problem hiding this comment.
the Drop implementation for storage should be gone, the metadata write can now be part of the flush in the disk storage
…o GraphStore::flush (in db4-storage). Gets the graph type from reading the .meta file. Checks to make sure the path hasn't changed.
… "io" feature in raphtory-api. Update write_metadata to take a Metadata (not GraphView) bc GraphView isn't available in raphtory-api. Update callsites to construct the Metadata. Add an error type in raphtory-api to avoid using GraphError.
… error types. Update InnerGraph to be ready (write_metadata doesn't take GraphView). replace_graph is now replace_graph_path and updates the metadata/removes the old dir. Encoding the new graph's data is handled separately in replace_graph_in_folder and stays in raphtory.
# Conflicts: # db4-storage/src/pages/mod.rs # raphtory-api/src/core/storage/graph_folder.rs
# Conflicts: # raphtory-api/src/core/storage/graph_folder.rs # raphtory-graphql/src/model/graph/meta_graph.rs # raphtory-graphql/src/paths.rs
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
Move graph_folder.rs constants (directory and file names regarding exported graphs) out of the raphtory crate and into raphtory-api.
Why are the changes needed?
Following previous changes, we needed access to GRAPH_META_PATH in pometry-storage, where we can't import from raphtory.
Does this PR introduce any user-facing change? If yes is this documented?
No
How was this patch tested?
Tests still pass
Are there any further changes required?
No