Skip to content

Restructure Project with UI-Based Credential Management and Pipeline Automation#4

Merged
essiebx merged 2 commits into
mainfrom
product-makeover
Feb 8, 2026
Merged

Restructure Project with UI-Based Credential Management and Pipeline Automation#4
essiebx merged 2 commits into
mainfrom
product-makeover

Conversation

@essiebx

@essiebx essiebx commented Feb 8, 2026

Copy link
Copy Markdown
Owner

This update restructures the entire project into a fully functional tool designed to serve both technical and non-technical users. The previous version of the tool was CLI-based, requiring users to manually interact with the pipeline and input credentials. In this new version, we've integrated a UI, which allows users to easily add their credentials, and the pipeline does all the work automatically.

Need for This Change:

  • Previous Version: The CLI-based approach required users to manually manage the pipeline, including adding credentials for various services.
  • New Version: With the newly restructured tool, users can now enter their credentials via a simple, user-friendly interface. The pipeline takes care of everything in the background, reducing complexity and making the process more accessible.

Key Changes:

  • User Interface: A new UI has been implemented, enabling users to input their credentials directly. This eliminates the need to interact with the CLI, simplifying the process.
  • Credential Management: Users now input their Google service account and PostgreSQL credentials through the UI, making the setup process smoother and more intuitive.
  • Automated Pipeline Execution: After credentials are entered, the tool automatically runs the pipeline, streamlining the workflow and reducing manual intervention.

Prerequisites:

To use the tool, users must have the following credentials:

  • Google Service Account: You will need a Google Cloud service account key (usually in JSON format).
  • PostgreSQL: You must know your PostgreSQL database credentials (username, password, database name, host, and port).

Benefits:

  • User Accessibility: Both technical and non-technical users can now easily manage the tool without needing to interact with the CLI.
  • Reduced Complexity: The new UI simplifies credential entry and automates the entire pipeline process, saving time and reducing errors.
  • Improved Workflow: With automatic background processing, the tool streamlines tasks and improves efficiency.

Next Steps:

  1. Prepare your credentials for both Google Service Account and PostgreSQL.
  2. Open the new UI, input your credentials in the provided fields.
  3. Sit back and let the pipeline run automatically in the background.

Please review and test the updated version of the tool, and let us know if you encounter any issues or have suggestions for further improvements!

essiebx added 2 commits February 7, 2026 16:24
…leanup

- Rewrote README.md into a professional PRD (Product Requirements Document).
- Redesigned frontend with a modern glassmorphism UI.
- Refactored monitoring and security modules for zero-dependency operation.
- Added programmatic BigQuery credentials and PostgreSQL table management.
- Simplified repository by removing legacy DevOps infrastructure (Terraform, K8s, Helm).
- Resolved extensive linting and code quality issues across the project.
- Added new file: =1.4
- Modified README.md
- Added new files: api.pid, dlq/dlq_extract_20260207.jsonl, dlq/dlq_load_create_table_20260207.jsonl
@essiebx
essiebx merged commit a6a827d into main Feb 8, 2026
2 of 4 checks passed
@essiebx
essiebx deleted the product-makeover branch February 8, 2026 09:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant