yangdx b5ae84fac6 fix: Add data consistency validation to document processing pipeline
- Add _validate_and_fix_document_consistency() method to detect and fix documents with missing content in full_docs storage
- Integrate consistency check into apipeline_process_enqueue_documents() to automatically mark inconsistent documents as FAILED before processing
- Prevent processing errors caused by documents having status records but missing actual content data
2025-08-14 06:18:34 +08:00
..
2025-08-09 08:41:41 +08:00
2025-06-29 01:28:39 +05:00
2025-08-14 03:07:29 +08:00