yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-24 09:26:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/test_unstructured_ingest/expected-structured-output/confluence-diff/testteamsp/1802252.json

402 lines
10 KiB
JSON
Raw Normal View History

feat: confluence connector (cloud) (#906) * Add confluence connector and an example script * add test script, add dependency installations * add authentication secret variables for ci tests and actions * add dependency installation commands for workflows * add dependency installation commands for workflows * Update ingest test fixtures (#907) Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com> * add add ingest test fixtures update workflow for python 3.10, update example script with dummy values * change workflow name to avoid confusion * change workflow name to avoid confusion * only leave 3.8 in ingest test matrix to test consistent partitioning among python versions, remove 3.10 workflow for the test fixtures update * only leave 3.8 in ingest test matrix to test consistent partitioning among python versions * Update ingest test fixtures (#911) Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com> * revert back the test python version matrix * recompile dependencies * modifications for shellcheck * update changelog and version * changelog and version * remove comments * Update ingest test fixtures (#915) Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com> * add the option to state the number of spaces to be fetched * add scroll functionality, expose --confluence-num-of-spaces, --confluence-list-of-spaces and --confluence-num-of-docs-from-each-space to users * add help message * add docstrings for two tests, validate grabbing every doc in the fetched spaces, count number of files instead of diffing for confluence2 test * change test names * rename connector arg Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> * change arg name for connector Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> * add comment to example * change arg names * add new tests to ingest test * shellcheck remove redundant statement * Update ingest test fixtures (#932) Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com> * Update ingest test fixtures (#936) Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com> * linting * change file extensions to parse as html * Update ingest test fixtures (#943) Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com> * remove old fixtures * update version to 0.8.2-dev3 * change file to trigger CI * change file to trigger CI * change file to trigger CI * change file to trigger CI --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: ahmetmeleq <ahmetmeleq@users.noreply.github.com>
2023-07-18 19:29:41 +01:00
[
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "Title",
"element_id": "e7f29a76338c0f4d24e30d18e6f336ee",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2 testtext2"
},
{
"type": "ListItem",
"element_id": "83cd16582f7c6143822c0954f7f00350",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 List Item 1Testdoc2 List Item 1 Nested Item ATestdoc2 List Item 1 Nested Item B"
},
{
"type": "ListItem",
"element_id": "4e97e8a96031986042c3bec526dd273f",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 List Item 2"
},
{
"type": "ListItem",
"element_id": "629e4dee8b4acc5b39782b4d012ab83c",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 List Item 3"
},
{
"type": "ListItem",
"element_id": "d177691364d515d6eaa385205a64664c",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 List Item 4"
},
{
"type": "ListItem",
"element_id": "f7a3306959cba883aca00f29ca138b6a",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 List Item 5"
},
{
"type": "NarrativeText",
"element_id": "3d15d9222ffb2770ceede5b6532e842a",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "This is the link for unstructured . io."
},
{
"type": "ListItem",
"element_id": "fcb6283714c2b7640835964291e59ebd",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Checklist Item 1"
},
{
"type": "ListItem",
"element_id": "899f082b917d5e6e380f15705db5923a",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Checklist Item 2 (checked)"
},
{
"type": "ListItem",
"element_id": "07005b9f1774ceabf978b2cc8afb7183",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Checklist Item 3"
},
{
"type": "UncategorizedText",
"element_id": "86e0e9ce51725074a3dc41ed3f10c13c",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "😃 😃 😃 😃 😃 😃 😃 😃 😃 😃 😃 😃"
},
{
"type": "NarrativeText",
"element_id": "72fa9ecafbf0df76a3b307485ce4c98b",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 bold text"
},
{
"type": "Title",
"element_id": "552ed5322965c5e1e8b235b0373f2470",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 italic text"
},
{
"type": "Title",
"element_id": "6e11265369ab068c620fc2a2b7b858f5",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Heading 1 Sized Text"
},
{
"type": "Title",
"element_id": "4da0847af03e9440530539d6da679e85",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Heading 2 Sized Text"
},
{
"type": "Title",
"element_id": "2003a49a54c45aae0cd7640f47ea3f41",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Heading 3 Sized Text"
},
{
"type": "Title",
"element_id": "ab09ddfa08278cd006e9ea2201c8989d",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Heading 4 Sized Text"
},
{
"type": "Title",
"element_id": "4ad754b028bec050fbff5ce2f50c60d1",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Heading 5 Sized Text"
},
{
"type": "Title",
"element_id": "7aa138ab1f6ef154504c3d8ade2fd1a0",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 1 Row 0"
},
{
"type": "Title",
"element_id": "b40b0fee79c609772c958caa07bd47a8",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 2 Row 0"
},
{
"type": "Title",
"element_id": "cc59bb6025ceae34c2b9c9d7cdbfbcf9",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 3 Row 0"
},
{
"type": "Title",
"element_id": "3cb373750d4e46b4bbc980dd0d74321e",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 1 Row 1"
},
{
"type": "Title",
"element_id": "219a8d1fc742fb75b2481a0a75c77a3b",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 2 Row 1"
},
{
"type": "Title",
"element_id": "07a1ad32c97f3669f88014ee5942f616",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 3 Row 1"
},
{
"type": "Title",
"element_id": "17228bddb06b739951fab2ab04c09ea8",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 1 Row 2"
},
{
"type": "Title",
"element_id": "4ad7ae00fff8c8a3f903864d037cf86e",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 2 Row 2"
},
{
"type": "Title",
"element_id": "f2701095922247ecafbbd3fe31d585bf",
"metadata": {
"data_source": {},
"filetype": "text/html",
"page_number": 1
},
"text": "Testdoc2 Table: Column 3 Row 2"
}
]
Reference in New Issue Copy Permalink