haystack/test/samples/crawler/page1.html

<!DOCTYPE html>
<html>
<head>
    <title>Test Page 1 for Crawler</title>
</head>
<body>
    <p>page 1 content</p>
    <a href="index.html">link to home</a>
    <a href="page2.html">link to page 2</a>
    <a href="page1_subpage1.html">link to subpage 1</a>
    <a href="page1_subpage2.html">link to subpage 2</a>
</body>
</html>
[CI refactoring] Rewrite `Crawler` tests (#2557) * Rewrite crawler tests (very slow) and fix small crawler bug * Update Documentation & Code Style * compile the regex only once * Factor out the html files & add content check to most tests * Clarify that even starting URLs can be excluded * Update Documentation & Code Style * Change signature * Fix failing test * Update Documentation & Code Style Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> 2022-06-06 17:52:37 +02:00			`<!DOCTYPE html>`
			`<html>`
			`<head>`
			`<title>Test Page 1 for Crawler</title>`
			`</head>`
			`<body>`
			`<p>page 1 content</p>`
			`<a href="index.html">link to home</a>`
			`<a href="page2.html">link to page 2</a>`
feat: arbitrary `crawler_depth` for `Crawler` class (#4623) * #3674 implemented iterative crawler depth * #3674 added two tests for increased crawler depth * removed old comment 2023-04-11 10:39:17 +02:00			`<a href="page1_subpage1.html">link to subpage 1</a>`
			`<a href="page1_subpage2.html">link to subpage 2</a>`
[CI refactoring] Rewrite `Crawler` tests (#2557) * Rewrite crawler tests (very slow) and fix small crawler bug * Update Documentation & Code Style * compile the regex only once * Factor out the html files & add content check to most tests * Clarify that even starting URLs can be excluded * Update Documentation & Code Style * Change signature * Fix failing test * Update Documentation & Code Style Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> 2022-06-06 17:52:37 +02:00			`</body>`
chore: fix all EOF (#3852) * fix all eof * fix test * fix test * fix test * typo * fix sample * fix sample * add logs * fix page_dynamic_result.txt 2023-01-16 12:34:50 +01:00			`</html>`