Skip to content

GML-1993 Local folder processing: added code for multiple files processing#12

Merged
chengbiao-jin merged 17 commits into
mainfrom
feature/other_file_support
Nov 3, 2025
Merged

GML-1993 Local folder processing: added code for multiple files processing#12
chengbiao-jin merged 17 commits into
mainfrom
feature/other_file_support

Conversation

@prinskumar-tigergraph

Copy link
Copy Markdown
Contributor

Added code for Local folder(miultiple files)

  • Image description generation is added
    -Moved code to common/utils

Pending task
-ability to allow customer to control the behavior of auto-processing or not
-Update README and Notebook
-Can it be done from UI, including uploading files or provide remote url/s3_bucket? (Separate to another task)

Comment thread common/utils/image_data_extractor.py
Comment thread common/utils/text_extractors.py Outdated
Comment thread graphrag/app/supportai/supportai.py Outdated
Comment thread graphrag/app/supportai/supportai.py Outdated
Comment thread graphrag/app/routers/ui.py Outdated
Comment thread configs/server_config.json Outdated
Comment thread ecc/app/supportai/workers.py Outdated
Comment thread graphrag/app/agent/agent.py Outdated
Comment thread graphrag/app/common
Comment thread graphrag/app/configs
Comment thread graphrag/app/supportai/supportai.py
Comment thread graphrag/app/supportai/supportai.py
Comment thread graphrag/app/agent/agent_graph.py Outdated
Comment thread ecc/app/graphrag/workers.py
Comment thread graphrag/app/agent/agent_graph.py Outdated
Comment thread graphrag/app/agent/agent_graph.py
Comment thread graphrag/app/agent/agent_graph.py
Comment thread graphrag/app/agent/agent_graph.py Outdated
Comment thread graphrag/app/agent/agent_graph.py Outdated
Comment thread graphrag/app/agent/agent_graph.py Outdated
Comment thread graphrag/app/routers/ui.py Outdated
and ingest_config.data_source.lower() == "server"
):
# Server multi can include images; use the WithImages loading job
file_path = "common/gsql/supportai/SupportAI_InitialLoadJSON_WithImages.gsql"

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Double check if this loading job works for payload without image fields. If it works, it can replace the old SupportAI_InitialLoadJSON.gsql directly.
Otherwise in supportai.py there should be a switch to use different loading jobs based on payload type.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

checked with only pdf code is working fine

@chengbiao-jin
chengbiao-jin merged commit 7be57d6 into main Nov 3, 2025
1 check failed
@chengbiao-jin
chengbiao-jin deleted the feature/other_file_support branch November 3, 2025 23:46
@chengbiao-jin chengbiao-jin changed the title Local folder processing: added code for multiple files processing GML-1993 Local folder processing: added code for multiple files processing Nov 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants