David S. Batista
91f57015c0
feat : adding split_id and split_overlap to DocumentSplitter (#7933)
* wip: adding _split_overlapp
* fixing join issue for _split_overlap
* adding tests
* adding release notes
* cleaning and fixing tests
* making mypy happy
* Update haystack/components/preprocessors/document_splitter.py
Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
* adding docstrings
---------
Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
2024-06-27 15:07:43 +02:00
..
2024-06-20 13:44:23 +02:00
2024-05-30 15:34:52 +02:00
2024-01-10 10:26:44 +01:00
2024-05-23 19:04:55 +02:00
2024-01-09 12:17:46 +01:00
2024-04-02 14:04:16 +02:00
2024-02-05 16:20:46 +01:00
2024-03-11 13:14:59 +01:00
2024-06-12 11:58:36 +02:00
2024-01-22 09:57:04 +01:00
2024-01-26 11:04:43 +01:00
2024-05-23 15:41:29 +00:00
2024-02-08 08:48:46 +01:00
2024-02-06 16:55:06 +01:00
2024-01-18 15:53:12 +01:00
2024-05-15 19:33:57 +00:00
2024-06-17 18:08:52 +02:00
2024-05-16 19:18:48 +02:00
2024-02-20 19:55:41 +01:00
2024-02-20 13:58:48 +01:00
2024-02-13 13:03:50 +01:00
2024-05-02 14:48:27 +02:00
2024-04-29 12:51:18 +02:00
2024-06-04 17:51:16 +02:00
2024-03-01 11:55:44 +01:00
2024-06-07 09:43:29 +00:00
2024-06-10 14:54:07 +02:00
2024-04-29 14:21:53 +02:00
2024-02-02 17:07:52 +01:00
2024-06-21 16:45:25 +02:00
2024-06-27 15:07:43 +02:00
2024-01-17 15:36:29 +01:00
2024-06-05 15:28:53 +02:00
2024-04-03 16:41:30 +02:00
2024-03-14 11:14:04 +01:00
2024-03-19 08:47:53 +01:00
2024-04-10 09:02:08 +02:00
2024-05-14 17:08:51 +02:00
2024-04-09 09:45:06 +02:00
2024-05-23 16:28:24 +02:00
2024-01-11 12:33:26 +01:00
2024-06-05 18:04:24 +02:00
2024-02-29 15:55:53 +01:00
2024-06-21 14:22:33 +02:00
2024-02-22 12:52:04 +01:00
2024-02-27 18:11:06 +01:00
2024-02-19 12:43:40 +01:00
2024-01-12 17:16:03 +01:00
2024-02-08 11:46:10 +01:00
2024-01-30 11:15:26 +01:00
2024-02-06 11:03:18 +01:00
2024-02-23 11:52:54 +01:00
2024-04-22 14:10:00 +02:00
2024-02-23 09:18:32 +01:00
2024-02-14 17:11:08 +01:00
2024-01-17 10:41:34 +01:00
2024-01-30 13:47:57 +01:00
2024-04-04 17:04:59 +02:00
2024-04-04 17:04:59 +02:00
2024-05-27 14:48:38 +02:00
2024-06-27 08:19:01 +02:00
2024-03-27 15:34:50 +01:00
2024-05-03 12:10:15 +00:00
2024-02-09 14:44:24 +01:00
2024-02-09 14:44:34 +01:00
2024-04-05 16:02:34 +02:00
2024-05-13 19:44:02 +02:00
2024-04-12 06:59:16 +00:00
2024-05-23 16:03:39 +02:00
2024-04-04 16:33:59 +00:00
2024-05-17 16:06:03 +02:00
2024-03-11 14:58:08 +01:00
2024-06-18 12:37:16 +02:00
2024-05-15 10:00:38 +02:00
2024-06-21 12:31:29 +02:00
2024-06-20 13:20:52 +02:00
2024-03-01 10:56:47 +01:00
2024-02-02 15:59:05 +01:00
2024-06-06 13:19:07 +00:00
2024-01-12 11:56:03 +01:00
2024-05-14 08:36:14 +02:00
2024-03-27 17:31:05 +01:00
2024-05-23 16:03:26 +02:00
2024-05-08 17:14:37 +02:00
2024-06-25 12:07:11 +02:00
2024-06-19 13:47:38 +02:00
2024-04-12 14:07:18 +00:00
2024-03-05 12:13:56 +01:00
2024-03-11 12:52:55 +01:00
2024-05-24 16:41:29 +02:00
2024-02-15 17:35:28 +01:00
2024-05-27 21:04:40 +02:00
2024-03-26 16:55:31 +01:00
2024-04-11 16:39:38 +02:00
2024-06-21 11:10:34 +02:00
2024-05-08 16:00:49 +02:00
2024-06-26 11:07:00 +02:00
2024-01-18 11:11:08 +01:00
2024-06-27 10:31:58 +02:00
2024-05-14 10:22:38 +00:00
2024-03-07 16:23:57 +01:00
2024-04-05 18:48:34 +02:00
2024-04-08 15:06:26 +02:00
2024-04-05 18:48:13 +02:00
2024-04-08 14:22:54 +02:00
2024-01-15 12:18:51 +01:00
2024-03-21 15:49:18 +01:00
2024-04-25 12:16:48 +02:00
2024-06-25 16:59:37 +02:00
2024-04-29 17:29:27 +02:00
2024-05-15 14:25:19 +02:00
2024-05-31 16:44:14 +02:00
2024-01-12 17:50:55 +01:00
2024-02-29 14:31:20 +01:00
2024-02-15 14:07:01 +01:00
2024-02-28 09:45:50 +01:00
2024-06-27 11:45:20 +02:00
2024-06-07 12:49:23 +02:00
2024-03-25 07:05:27 +01:00
2024-02-27 10:06:53 +01:00
2024-02-27 18:31:51 +01:00
2024-05-29 10:54:21 +02:00
2024-02-19 10:05:35 +01:00
2024-02-06 09:59:25 +01:00
2024-02-12 18:25:28 +01:00
2024-02-01 12:50:11 +01:00
2024-01-16 08:52:58 +01:00
2024-02-13 13:08:35 +01:00
2024-06-12 10:42:02 +02:00
2024-01-09 17:56:20 +01:00
2024-05-14 12:24:55 +02:00
2024-02-09 16:03:27 +01:00
2024-02-22 14:03:50 +01:00
2024-02-22 14:30:58 +01:00
2024-06-17 10:54:02 +02:00
2024-02-28 16:43:08 +01:00
2024-03-21 12:55:06 +01:00
2024-02-26 09:25:07 +01:00
2024-04-10 17:47:14 +02:00
2024-05-10 11:35:15 +02:00
2024-04-10 17:16:00 +02:00
2024-04-24 12:27:18 +02:00
2024-05-14 12:29:41 +02:00
2024-02-16 17:07:52 +01:00
2024-02-07 16:03:17 +01:00
2024-01-18 08:54:59 +01:00
2024-03-26 10:09:29 +01:00
2024-06-21 16:52:03 +02:00
2024-01-16 13:40:22 +01:00
2024-01-25 15:29:19 +01:00
2024-05-23 09:35:10 +02:00
2024-03-26 16:15:03 +01:00
2024-01-10 21:20:42 +01:00
2024-01-29 17:26:11 +01:00
2024-02-26 16:06:26 +01:00
2024-03-05 12:45:53 +01:00
2024-02-06 11:31:53 +01:00
2024-01-12 14:40:30 +01:00
2024-01-12 15:30:17 +01:00
2024-01-16 15:32:48 +01:00
2024-01-12 17:09:12 +01:00
2024-01-15 14:48:33 +01:00
2024-01-26 16:00:02 +01:00
2024-01-12 12:58:01 +01:00
2024-06-04 17:51:16 +02:00
2024-06-21 10:36:12 +02:00
2024-06-21 11:15:13 +02:00
2024-01-09 14:59:22 +01:00
2024-03-01 17:39:13 +01:00
2024-02-14 16:16:22 +01:00
2024-04-04 10:10:41 +02:00
2024-02-05 13:17:01 +01:00
2024-02-19 14:52:44 +01:00
2024-06-14 17:52:32 +02:00
2024-01-12 12:22:45 +01:00
2024-05-22 13:14:39 +02:00
2024-01-12 16:56:52 +01:00
2024-01-09 10:49:37 +01:00
2024-01-09 14:44:39 +01:00
2024-01-09 09:49:47 +01:00
2024-04-23 19:03:41 +02:00
2024-05-09 15:11:43 +00:00
2024-03-19 18:04:16 +01:00
2024-01-26 09:47:52 +01:00
2024-02-14 16:48:03 +01:00
2024-06-18 12:37:16 +02:00
2024-02-27 09:15:01 +01:00
2024-02-15 16:10:38 +01:00
2024-03-21 09:28:21 +01:00
2024-05-17 10:38:47 +02:00
2024-04-03 10:48:50 +02:00
2024-02-05 13:17:01 +01:00
2024-03-05 13:04:53 +01:00
2024-06-20 18:15:01 +02:00
2024-03-19 07:53:26 +01:00
2024-05-03 10:14:54 +02:00
2024-03-26 16:10:06 +01:00
2024-01-24 15:45:53 +01:00
2024-02-16 11:25:53 +01:00
2024-03-15 13:56:07 +01:00