Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
3f963bb
global and local build config with profiling flags.
harish876 Nov 15, 2024
804dcd1
integrated basic memory hook for RSS calculation
harish876 Nov 15, 2024
b67fa88
edited script to generate callgraph using gprof
harish876 Nov 15, 2024
4404af5
enabling level db as default storage engine
harish876 Nov 15, 2024
33c16f2
systemd telegraf script to stream prometheus node_exporter data to In…
harish876 Nov 15, 2024
7c35fe8
added lmdb storage engine interface and partially implemented.
harish876 Nov 16, 2024
ccade23
bootstrapping script to run perf tools
harish876 Nov 30, 2024
c625f78
adding process exporter to bootstrapping script
harish876 Nov 30, 2024
e1ce45d
Added LRU Cache and Observabiity stats
harish876 Dec 9, 2024
676a5d3
Merge pull request #1 from harish876/memory-hooks-integration
harish876 Jan 12, 2025
491b254
lry cache controlled using settings
harish876 Feb 12, 2025
4adc82f
Merge branch 'apache:master' into master
harish876 Feb 12, 2025
7eb9fff
removing lmdb implementation
harish876 Feb 12, 2025
d8cbe16
removing unecessary scripts
harish876 Feb 12, 2025
71975f2
Resolving comments for build flags and memory leak
harish876 Feb 17, 2025
35ed786
resolved error. options.block_cache_ integration still not working
harish876 Feb 17, 2025
b9b3363
added UT's for TC's. removed logs from stats and changed lru implemen…
harish876 Feb 19, 2025
0d02a14
reverting configs and removing unwanted files
harish876 Feb 19, 2025
8348689
removing unwanted tst logs
harish876 Feb 19, 2025
0a85b15
refactor: rename GetMetrics to UpdateMetrics and improve cache handli…
harish876 Mar 7, 2025
ccb268d
feat: add LevelDB block cache support and corresponding tests.
harish876 Mar 7, 2025
4cd5b88
feat: enhance LevelDB block cache with configurable capacity and upda…
harish876 Mar 7, 2025
a642ef8
refactor: update transaction summary variable names for consistency
harish876 Mar 7, 2025
08203e3
build: optimize compilation flags by adding optimization level
harish876 Mar 7, 2025
94d2a72
build: remove debugging flags from kv_service and api_tools builds
harish876 Mar 14, 2025
a759dda
build: remove profiling flags from set_random_data binary
harish876 Mar 14, 2025
a0a136f
build: remove pyroscope monitoring from kv service startup script
harish876 Mar 15, 2025
32b5758
build: include string header in lru_cache implementation
harish876 Mar 15, 2025
f04774b
Merge pull request #2 from apache/master
harish876 Aug 5, 2025
82f6b60
Add GetByPrefix method to Storage interface and implement composite k…
harish876 Aug 5, 2025
d9449e3
Add composite key support to KVRequest and KVResponse messages
harish876 Aug 5, 2025
bd61272
Update GetByPrefix method in Storage interface to return a vector of …
harish876 Aug 5, 2025
f7f645d
Remove optional composite_results field from KVResponse message
harish876 Aug 5, 2025
897d270
Add composite key functionality to KVExecutor and implement GetByPref…
harish876 Aug 17, 2025
ae2dca7
Refactor Storage methods for key retrieval and add new functionality
harish876 Aug 18, 2025
bb7ada8
Remove unused composite key test helper methods and clean up test cas…
harish876 Aug 18, 2025
a941e67
Bug fixes for Smart Contract executor
harish876 Aug 21, 2025
9f9f03c
Revert "Bug fixes for Smart Contract executor"
harish876 Aug 21, 2025
47d9230
Fixed conflicts
harish876 Aug 21, 2025
4f85a94
Update Composite Keys
harish876 Aug 25, 2025
3374f87
Adding Preliminary bench scripts
harish876 Aug 28, 2025
b051bba
added rocksdb for secondary key experiments
harish876 Sep 3, 2025
2e9d61f
Chenyi track latest executed seq number each replica
harish876 Sep 25, 2025
352858d
Merge branch 'addfunctions' of https://github.com/cyzhoutt/addfunct i…
harish876 Sep 26, 2025
4d797f6
Comment out functions related to getting the latest executed sequence…
harish876 Sep 28, 2025
427e753
Undoing Chenyi Feature Changes
bchou9 Oct 12, 2025
c413e2c
Refactor KVExecutor and storage classes to streamline delete operatio…
harish876 Oct 20, 2025
9c6943c
Refactor KVExecutor to implement a new composite key builder pattern.…
harish876 Oct 20, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .bazelrc
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
build --cxxopt='-std=c++17' --copt=-O3 --jobs=40
build --cxxopt='-std=c++17' --copt="-pg" --linkopt="-pg" --strip=never --jobs=2
# build --cxxopt='-std=c++17' --copt=-O3 --jobs=40
#build --action_env=PYTHON_BIN_PATH="/usr/bin/python3.10"
#build --action_env=PYTHON_LIB_PATH="/usr/include/python3.10"

27 changes: 27 additions & 0 deletions WORKSPACE
Original file line number Diff line number Diff line change
Expand Up @@ -182,6 +182,26 @@ http_archive(
url = "https://github.com/google/leveldb/archive/refs/tags/1.23.zip",
)

bind(
name = "zstd",
actual = "//third_party:zstd",
)

http_archive(
name = "com_facebook_zstd",
build_file_content = all_content,
strip_prefix = "zstd-1.5.2",
url = "https://github.com/facebook/zstd/archive/refs/tags/v1.5.2.zip",
)

http_archive(
name = "com_github_facebook_rocksdb",
build_file = "@com_resdb_nexres//third_party:rocksdb.BUILD",
sha256 = "928cbd416c0531e9b2e7fa74864ce0d7097dca3f5a8c31f31459772a28dbfcba",
strip_prefix = "rocksdb-7.2.2",
url = "https://github.com/facebook/rocksdb/archive/refs/tags/v7.2.2.zip",
)

bind(
name = "snappy",
actual = "@com_google_snappy//:snappy",
Expand Down Expand Up @@ -257,3 +277,10 @@ http_archive(
strip_prefix = "asio-asio-1-26-0",
url = "https://github.com/chriskohlhoff/asio/archive/refs/tags/asio-1-26-0.zip",
)

http_archive(
name = "com_google_benchmark",
sha256 = "6bc180a57d23d4d9515519f92b0c83d61b05b5bab188961f36ac7b06b0d9e9ce",
strip_prefix = "benchmark-1.8.3",
urls = ["https://github.com/google/benchmark/archive/v1.8.3.tar.gz"],
)
37 changes: 37 additions & 0 deletions benchmark/storage/BUILD
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#

package(default_visibility = ["//visibility:public"])

cc_binary(
name = "composite_key_benchmark",
srcs = ["composite_key_benchmark.cpp"],
deps = [
"//executor/kv:kv_executor",
"//chain/storage:leveldb",
"//chain/storage:rocksdb",
"//proto/kv:kv_cc_proto",
"@com_google_benchmark//:benchmark",
"@nlohmann_json//:json",
"@com_github_google_glog//:glog",
],
copts = [
"-std=c++17",
"-O2",
],
)
270 changes: 270 additions & 0 deletions benchmark/storage/RESULTS.md

Large diffs are not rendered by default.

Loading
Loading