[EPIC] Expand Knowledge Document Ingestion Pipeline

[aakankshaduggal]

Add support for ingesting and processing various document types (Markdown, PDF, DOCX, etc.) into formats compatible with SDG workflows.

Key Features:

• InstructLab Schema: Define an instructlab schema to standardize input formats for SDG and RAG.
• Docling Integration: Use Docling for converting document formats (PDF, DOCX, HTML) into JSON-compatible schema.
• Document Chunking Command: Develop ilab document format for chunking and formatting documents as per SDG schema.
• Simplified Git Workflows: Introduce script to handle Git repo setup, structure, and file organization for knowledge documents.

[github-actions]

This issue has been automatically marked as stale because it has not had activity within 90 days. It will be automatically closed if no further activity occurs within 30 days.

[github-actions]

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant!