fix: update slack test to point to new channel (#3328)

When we switched community Slack from Paid to Free we lost the CI test
bot. Also if messages delete after 90 days then our expected test data
will disappear.

- created a new bot in our paid company slack
(test_unstructured_ingest_bot)
- added a new private channel (test-ingest)
- invited the bot to the channel
- adjusted the end datetime of the test to cover the first few messages
in the channel

Still to do:
- update the CI secrets with the new bot token
- update the LastPass with the new bot token (I don't have write
access.. :(.

.github/workflows/ci.yml

@@ -530,4 +530,5 @@ jobs:
         with:
           image: "unstructured:dev"
           # NOTE(robinson) - revert this to medium when we bump libreoffice
-          severity-cutoff: high
+          severity-cutoff: critical
+          only-fixed: true

CHANGELOG.md

@@ -1,4 +1,4 @@
-## 0.14.10-dev0
+## 0.14.10-dev1
 
 ### Enhancements
 
@@ -6,6 +6,8 @@
 
 ### Fixes
 
+* **Fix Slack CI test** Change channel that Slack test is pointing to because previous test bot expired
+
 ## 0.14.9
 
 ### Enhancements

test_unstructured_ingest/expected-structured-output/slack/C052BGT7718.json

@@ -1,50 +0,0 @@
-[
-  {
-    "element_id": "5df397cc48371b33609230377fff0698",
-    "metadata": {
-      "data_source": {
-        "date_created": "2023-04-07T19:57:55.231559",
-        "date_modified": "2023-04-07T22:19:56.520459"
-      },
-      "filename": "C052BGT7718.xml",
-      "filetype": "application/xml",
-      "languages": [
-        "eng"
-      ]
-    },
-    "text": "testing <reply> testing <reply> threads are cool",
-    "type": "NarrativeText"
-  },
-  {
-    "element_id": "600e3fddd88eef2f72e62382247d0444",
-    "metadata": {
-      "data_source": {
-        "date_created": "2023-04-07T19:57:55.231559",
-        "date_modified": "2023-04-07T22:19:56.520459"
-      },
-      "filename": "C052BGT7718.xml",
-      "filetype": "application/xml",
-      "languages": [
-        "eng"
-      ]
-    },
-    "text": "<@U051UBRR946> has joined the channel <reply> <@U051UBRR946> has joined the channel",
-    "type": "NarrativeText"
-  },
-  {
-    "element_id": "05ac2c54bb9f4ab5c69faf65d75fed0c",
-    "metadata": {
-      "data_source": {
-        "date_created": "2023-04-07T19:57:55.231559",
-        "date_modified": "2023-04-07T22:19:56.520459"
-      },
-      "filename": "C052BGT7718.xml",
-      "filetype": "application/xml",
-      "languages": [
-        "eng"
-      ]
-    },
-    "text": "<@U04ST78RXU3> has joined the channel <reply> <@U04ST78RXU3> has joined the channel",
-    "type": "NarrativeText"
-  }
-]

test_unstructured_ingest/expected-structured-output/slack/C07ABKJ83C6.json

@@ -0,0 +1,66 @@
+[
+  {
+    "element_id": "fe8afe4ca1990d462f6a670627ef8964",
+    "metadata": {
+      "data_source": {
+        "date_created": "2024-07-01T14:42:39.236409",
+        "date_modified": "2024-07-01T14:45:22.687169"
+      },
+      "filename": "C07ABKJ83C6.xml",
+      "filetype": "application/xml",
+      "languages": [
+        "eng"
+      ]
+    },
+    "text": "<@U07AWSE7U4R> has joined the channel <reply> <@U07AWSE7U4R> has joined the channel",
+    "type": "NarrativeText"
+  },
+  {
+    "element_id": "e75bd9aeb2738388477c9b8961ebd31d",
+    "metadata": {
+      "data_source": {
+        "date_created": "2024-07-01T14:42:39.236409",
+        "date_modified": "2024-07-01T14:45:22.687169"
+      },
+      "filename": "C07ABKJ83C6.xml",
+      "filetype": "application/xml",
+      "languages": [
+        "eng"
+      ]
+    },
+    "text": "<@U07AWSE7U4R> <reply> <@U07AWSE7U4R>",
+    "type": "Title"
+  },
+  {
+    "element_id": "22af1ce921c1cf4590e7d4e0a96f5f1a",
+    "metadata": {
+      "data_source": {
+        "date_created": "2024-07-01T14:42:39.236409",
+        "date_modified": "2024-07-01T14:45:22.687169"
+      },
+      "filename": "C07ABKJ83C6.xml",
+      "filetype": "application/xml",
+      "languages": [
+        "eng"
+      ]
+    },
+    "text": "this is an unstructured CI test channel <reply> this is an unstructured CI test channel",
+    "type": "NarrativeText"
+  },
+  {
+    "element_id": "4e7f2e396c292ae8bdcf683e84733dc2",
+    "metadata": {
+      "data_source": {
+        "date_created": "2024-07-01T14:42:39.236409",
+        "date_modified": "2024-07-01T14:45:22.687169"
+      },
+      "filename": "C07ABKJ83C6.xml",
+      "filetype": "application/xml",
+      "languages": [
+        "eng"
+      ]
+    },
+    "text": "<@U06EUA16DJ6> has joined the channel <reply> <@U06EUA16DJ6> has joined the channel",
+    "type": "NarrativeText"
+  }
+]

test_unstructured_ingest/src/slack.sh

@@ -40,10 +40,10 @@ PYTHONPATH=${PYTHONPATH:-.} "$RUN_SCRIPT" \
   --reprocess \
   --output-dir "$OUTPUT_DIR" \
   --verbose \
-  --channels C052BGT7718 \
+  --channels C07ABKJ83C6 \
   --token "${SLACK_TOKEN}" \
   --start-date 2023-04-01 \
-  --end-date 2023-04-08T12:00:00-08:00 \
+  --end-date 2024-07-01T07:47:00-07:00 \
   --work-dir "$WORK_DIR"
 
 "$SCRIPT_DIR"/check-diff-expected-output.sh $OUTPUT_FOLDER_NAME

unstructured/__version__.py

@@ -1 +1 @@
-__version__ = "0.14.10-dev0"  # pragma: no cover
+__version__ = "0.14.10-dev1"  # pragma: no cover