Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
a859449
feat: Add ZeroMQ support for DFTracer
izzet May 27, 2025
250907b
Add ChromeWriter performance test
izzet Jun 15, 2025
c7d3080
Refactor CMake utility functions for consistency and readability
izzet Jun 15, 2025
dc50160
Merge branch 'develop' into feature/streaming
izzet Jun 29, 2025
10d927e
Merge remote-tracking branch 'origin/test/chrome-writer' into feature…
izzet Jun 29, 2025
ac3cd86
Add Perfetto-based file writers and remove legacy ZeroMQ writer
izzet Jul 1, 2025
01a5c64
Merge remote-tracking branch 'origin/fix/cmake-util-ext-proj' into fe…
izzet Jul 1, 2025
e3bcada
Update VSCode settings for CMake configuration
izzet Jul 1, 2025
00696fb
Add 'tmp/' to .gitignore to exclude temporary files
izzet Jul 1, 2025
85cc44e
Refactor Perfetto writer classes and add file writer test implementation
izzet Jul 6, 2025
3893530
Remove redundant initialization parameter
izzet Jul 8, 2025
74517a9
Fix constructor member initialization order in PerfettoChromeFileWriter
izzet Jul 8, 2025
fcea0ed
Refactor event logging in test_file_writer to use consistent variable…
izzet Jul 8, 2025
4d2a5cf
Add support for PERFETTO_CHROME_ZMQ writer type
izzet Jul 14, 2025
512b94e
Update PerfettoProtoFileWriter initialization and remove redundant mutex
izzet Jul 14, 2025
546712b
Merge remote-tracking branch 'origin/develop' into feature/streaming
izzet Jul 28, 2025
21791a2
Update default writer type to PERFETTO_CHROME_ZMQ
izzet Jul 28, 2025
0051fd4
Set default CMake policy version for external project installations
izzet Jul 28, 2025
4565449
Refactor ZeroMQ references to use 'zmq' for consistency and clarity i…
izzet Jul 28, 2025
231a63c
Rename ZMQ references to ZeroMQ for consistency in CMake configuration
izzet Jul 28, 2025
5977455
Implement fork handling for ZeroMQ socket reinitialization in child p…
izzet Jul 29, 2025
4635ced
Add DFTRACER_WRITER_TYPE environment variable and update logging init…
izzet Jul 29, 2025
303d0fc
Merge branch 'develop' into feature/streaming
izzet Nov 14, 2025
58db384
Merge branch 'develop' into feature/streaming
izzet Nov 24, 2025
4143c5e
feat: Replace ZMQ writer with a new Mofka writer and introduce a writ…
izzet Jan 4, 2026
f8959bd
feat: update Mofka writer test launch configurations.
izzet Jan 5, 2026
3b57908
Fix Mofka group file name in test env
izzet Jan 5, 2026
f27d4b4
Handle reinit in Mofka writer due to fork
izzet Jan 5, 2026
47e073d
Initialize init_pid_ to 0 in MofkaWriter for improved stability
izzet Jan 5, 2026
ff68974
fix: correct log message format for aggregation_file in Configuration…
izzet Feb 16, 2026
f4a2e9a
Improve CMake build configuration to work with Spack env
izzet Feb 16, 2026
47d2352
fix: add explicit linking for std::filesystem on GNU toolchains
izzet Feb 19, 2026
ca92a6f
fix: ensure directory exists before creating symlinks for Python bind…
izzet Feb 19, 2026
3827e7d
test: improve mofka server management and test configuration
izzet Feb 20, 2026
8dbfad0
feat(writer): add ZeroMQ writer for streaming trace data
izzet Feb 21, 2026
3804866
feat(tests): enhance dlio_benchmark tests with fixture requirements f…
izzet Feb 22, 2026
8b5349f
feat(writer): implement control hooks in MofkaWriter for event handling
izzet Mar 2, 2026
3faf8f8
fix(dependencies): update pydftracer to use specific git repository f…
izzet Mar 3, 2026
149d373
feat(writer): support forked child processes in MofkaWriter
izzet Mar 6, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,7 @@ pydftracer.egg-info

# Debug files
/*.core
tmp/

dfanalyzer_old/dask/run_dir
dfanalyzer_old/dask/logs
Expand Down
39 changes: 35 additions & 4 deletions .vscode/launch.json
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@
}
},
{
"name": "testc",
"name": "testc-stdio",
"type": "lldb",
"request": "launch",
"program": "${workspaceFolder}/build/bin/test_c",
Expand All @@ -164,15 +164,46 @@
],
"cwd": "${workspaceFolder}/build",
"env": {
"DFTRACER_DATA_DIR": "${workspaceFolder}/build/test/data",
"DFTRACER_ENABLE": "1",
"DFTRACER_INC_METADATA": "1",
"DFTRACER_LOG_FILE": "${workspaceFolder}/build/test/test_c_basic_only",
"DFTRACER_LOG_LEVEL": "DEBUG",
"DFTRACER_TRACE_COMPRESSION": "1",
"DFTRACER_TRACE_COMPRESSION": "0",
"DFTRACER_WRITER_TYPE": "STDIO",
"LD_LIBRARY_PATH": "${workspaceFolder}/build/lib",
"LD_PRELOAD": "${workspaceFolder}/build/lib64/libdftracer_preload_dbg.so",
},
"initCommands": [
"settings set target.process.follow-fork-mode child"
]
},
{
"name": "testc-mofka",
"type": "lldb",
"request": "launch",
"program": "${workspaceFolder}/build/bin/test_c",
"args": [
"${workspaceFolder}/build/test/data",
"1"
],
"cwd": "${workspaceFolder}/build",
"env": {
"DFTRACER_DATA_DIR": "${workspaceFolder}/build/test/data",
"DFTRACER_LOG_FILE": "${workspaceFolder}/build/test/test_c_basic_only",
"DFTRACER_ENABLE": "1",
"DFTRACER_INC_METADATA": "1",
"DFTRACER_LOG_FILE": "${workspaceFolder}/build/test/test_c_basic_only",
"DFTRACER_LOG_LEVEL": "DEBUG",
"DFTRACER_MOFKA_GROUP_FILE": "${workspaceFolder}/build/test/mofka.group.json",
"DFTRACER_MOFKA_TOPIC_NAME": "test_c",
"DFTRACER_TRACE_COMPRESSION": "0",
"DFTRACER_WRITER_TYPE": "MOFKA",
"LD_LIBRARY_PATH": "${workspaceFolder}/build/lib",
"LD_PRELOAD": "${workspaceFolder}/build/lib64/libdftracer_preload_dbg.so",
}
},
"initCommands": [
"settings set target.process.follow-fork-mode child"
]
},
]
}
29 changes: 17 additions & 12 deletions .vscode/settings.json
Original file line number Diff line number Diff line change
@@ -1,17 +1,26 @@
{
"cmake.configureArgs": [
"-DDFTRACER_INSTALL_DEPENDENCIES=OFF",
"-DDFTRACER_ENABLE_TESTS=ON",
"-DENABLE_PAPER_TESTS=OFF",
"-DCMAKE_C_COMPILER=/usr/tce/bin/gcc",
"-DCMAKE_CXX_COMPILER=/usr/tce/bin/g++",
"-DCMAKE_INSTALL_PREFIX=/usr/workspace/izzet/projects/dftracer-streaming/install",
"-DDFTRACER_BUILD_DEPENDENCIES=OFF",
"-DDFTRACER_DISABLE_HWLOC=ON",
"-DDFTRACER_ENABLE_DLIO_BENCHMARK_TESTS=OFF",
"-DDFTRACER_DISABLE_HWLOC=OFF",
"-DCMAKE_INSTALL_PREFIX=/usr/workspace/haridev/dftracer/install",
"-DDFTRACER_ENABLE_MPI=OFF"
"-DDFTRACER_ENABLE_PAPER_TESTS=OFF",
"-DDFTRACER_ENABLE_TESTS=ON",
"-DDFTRACER_INSTALL_DEPENDENCIES=OFF",
"-DDFTRACER_WRITER_TYPE=PERFETTO_PROTO_FILE"
],
"cmake.configureEnvironment": {
"DARSHAN_PRELOAD_LIB": "/usr/WS2/haridev/spack/opt/spack/linux-rhel8-zen2/gcc-10.3.1/darshan-runtime-3.4.4-vckxthkq2hzzxnwmk4owtzcnfmjwl23s/lib/libdarshan.so",
// "DARSHAN_PRELOAD_LIB": "/usr/WS2/haridev/spack/opt/spack/linux-rhel8-zen2/gcc-10.3.1/darshan-runtime-3.4.4-vckxthkq2hzzxnwmk4owtzcnfmjwl23s/lib/libdarshan.so",
"DFTRACER_TEST_MACHINE": "corona"
},
"C_Cpp.intelliSenseMemoryLimit": 16384,
"cSpell.words": [
"DFTRACER",
"dlio"
],
"editor.formatOnSave": true,
"files.associations": {
"any": "cpp",
"functional": "cpp",
Expand Down Expand Up @@ -98,9 +107,5 @@
"*.in": "cpp",
"text_encoding": "cpp"
},
"editor.formatOnSave": true,
"cSpell.words": [
"DFTRACER",
"dlio"
]
"git.ignoreLimitWarning": true
}
Loading