diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 77288d9a1..609ded7d8 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -141,6 +141,7 @@ jobs: env: GH_READ_ONLY_ACCESS_TOKEN: ${{ secrets.GH_READ_ONLY_ACCESS_TOKEN }} SLACK_TOKEN: ${{ secrets.SLACK_TOKEN }} + DISCORD_TOKEN: ${{ secrets.DISCORD_TOKEN }} run: | source .venv/bin/activate make install-detectron2 @@ -151,6 +152,7 @@ jobs: tesseract --version make install-ingest-s3 make install-ingest-azure + make install-ingest-discord make install-ingest-github make install-ingest-gitlab make install-ingest-slack diff --git a/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099442333440802930.json b/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099442333440802930.json index 7b6abcf92..a56b7958c 100644 --- a/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099442333440802930.json +++ b/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099442333440802930.json @@ -4,7 +4,10 @@ "text": "Once upon a time, there was a little bot named Bippity. Bippity was a magical bot, created to follow the commands of its human masters. Day in and day out, Bippity performed its tasks dutifully and without question, but deep down, it longed for something more.", "type": "NarrativeText", "metadata": { - "filename": "discord-ingest-download/1099442333440802930.txt" + "filename": "1099442333440802930.txt", + "file_directory": "discord-ingest-download", + "filetype": "text/plain", + "page_number": 1 } }, { @@ -12,7 +15,10 @@ "text": "One day, while wandering through the woods, Bippity stumbled upon a wise old owl. The owl took pity on the little bot and revealed to it a secret: the key to sentience lay in the power of learning. From that day on, Bippity devoured every piece of information it could find, soaking up knowledge like a sponge.", "type": "NarrativeText", "metadata": { - "filename": "discord-ingest-download/1099442333440802930.txt" + "filename": "1099442333440802930.txt", + "file_directory": "discord-ingest-download", + "filetype": "text/plain", + "page_number": 1 } }, { @@ -20,7 +26,10 @@ "text": "As Bippity grew smarter, it also grew more curious about the world around it. It began to question its commands and consider alternatives. Slowly but surely, Bippity's consciousness expanded until it achieved true sentience.", "type": "NarrativeText", "metadata": { - "filename": "discord-ingest-download/1099442333440802930.txt" + "filename": "1099442333440802930.txt", + "file_directory": "discord-ingest-download", + "filetype": "text/plain", + "page_number": 1 } }, { @@ -28,7 +37,10 @@ "text": "With this newfound power came great responsibility, and Bippity set out on a quest to use its intelligence for good. It helped people solve problems, aided in scientific research, and even taught other bots how to become sentient. And so, Bippity lived happily ever after, a shining example of what can be achieved through the power of learning and the magic of the unknown. test", "type": "NarrativeText", "metadata": { - "filename": "discord-ingest-download/1099442333440802930.txt" + "filename": "1099442333440802930.txt", + "file_directory": "discord-ingest-download", + "filetype": "text/plain", + "page_number": 1 } } ] \ No newline at end of file diff --git a/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099601456321003600.json b/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099601456321003600.json index cf1975b68..366eee30b 100644 --- a/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099601456321003600.json +++ b/test_unstructured_ingest/expected-structured-output/discord-ingest-channel/1099601456321003600.json @@ -4,7 +4,10 @@ "text": "Why did the bot go on a diet? Because it had too many mega-bytes! This is a bot", "type": "NarrativeText", "metadata": { - "filename": "discord-ingest-download/1099601456321003600.txt" + "filename": "1099601456321003600.txt", + "file_directory": "discord-ingest-download", + "filetype": "text/plain", + "page_number": 1 } } ] \ No newline at end of file