mirror of
https://github.com/quickwit-oss/quickwit.git
synced 2026-10-28 18:59:44 +08:00
Remi Dettai
6fa3c295fa
* Refactor file source * More explicit reponse for read_batch * Fix clippy * Remove batch logic from DocFileReader * Address styling comments * Replace FileSourceParams path with URI * Additional URI related cleanup * Fix unit tests to now use the URI * Add queue source with SQS implementation * Fix the publish_token strategy * Fix never-used warnings * Fix unit tests * Abort visibility task after acknowledging * Address smaller review comments * Shorten visibility extension task * Fix pulsar tests * Adjustments after rebase * Move object backed source to file source * Simpler flow for adhoc file processing * Fix tests and refactor batch creation to BatchReader * Add max_messages param to Queue.receive * Move use_shard_api to the metastore crate * Dedup within batches * Improve visibility task * Re-acquire partitions aggressively * Address simpler review comments * Add test for visibility actor (failing) * Fix visibility actor drop * Fix reader edge case * Add end to end tests * Improve integration test scenario * Chunk receive future to avoid hanging actor * Improve error handling * Fix flaky test * New SourceConfig format with notifications field * Improvements to error handling * Clarification of Queue contract * Address new round of review comments * Remove SqsSource for now * Fix panic * Revert to forbidding any adhoc file source through the API * Add docs * Fix panic on empty file * Documentation improvments * Improve documentation * Improve error handling code and associated docs * Nitpic and TODO cleanup * Add tip about ingests directly from object stores * Ack notifications of undesired type * Add docs about situations where messages require a DLQ * Fix integ test after rebase
