mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-07-15 04:55:56 +00:00
d5a6f4b82c
To test: > cd docs && make html Change logs: * Updates the best practice for table extraction to use `skip_infer_table_types` instead of `pdf_infer_table_structure`. * Fixed CSS issue with a duplicate search box. * Fixed RST warning message * Fixed typo on the Intro page.
74 lines
2.7 KiB
ReStructuredText
74 lines
2.7 KiB
ReStructuredText
Table Extraction from PDF
|
|
=========================
|
|
|
|
This section describes two methods for extracting tables from PDF files.
|
|
|
|
.. note::
|
|
|
|
To extract tables from any documents, set the ``strategy`` parameter to ``hi_res`` for both methods below.
|
|
|
|
Method 1: Using `partition_pdf`
|
|
-------------------------------
|
|
|
|
To extract the tables from PDF files using the `partition_pdf <https://unstructured-io.github.io/unstructured/core/partition.html#partition-pdf>`__, set the ``infer_table_structure`` parameter to ``True`` and ``strategy`` parameter to ``hi_res``.
|
|
|
|
**Usage**
|
|
|
|
.. code-block:: python
|
|
|
|
from unstructured.partition.pdf import partition_pdf
|
|
|
|
fname = "example-docs/layout-parser-paper.pdf"
|
|
|
|
elements = partition_pdf(filename=fname,
|
|
infer_table_structure=True,
|
|
strategy='hi_res',
|
|
)
|
|
|
|
tables = [el for el in elements if el.category == "Table"]
|
|
|
|
print(tables[0].text)
|
|
print(tables[0].metadata.text_as_html)
|
|
|
|
Method 2: Using Auto Partition or Unstructured API
|
|
--------------------------------------------------
|
|
|
|
By default, table extraction from ``pdf``, ``jpg``, ``png``, ``xls``, and ``xlsx`` file types is disabled. To enable table extraction from PDFs and other file types using `Auto Partition <https://unstructured-io.github.io/unstructured/core/partition.html#partition>`__ or `Unstructured API parameters <https://unstructured-io.github.io/unstructured/apis/api_parameters.html>`__ , you can set the ``skip_infer_table_types`` parameter to ``'[]'`` and ``strategy`` parameter to ``hi_res``.
|
|
|
|
|
|
**Usage: Auto Partition**
|
|
|
|
.. code-block:: python
|
|
|
|
from unstructured.partition.auto import partition
|
|
|
|
filename = "example-docs/layout-parser-paper.pdf"
|
|
|
|
elements = partition(filename=filename,
|
|
strategy='hi_res',
|
|
skip_infer_table_types='[]', # don't forget to include apostrophe around the square bracket
|
|
)
|
|
|
|
tables = [el for el in elements if el.category == "Table"]
|
|
|
|
print(tables[0].text)
|
|
print(tables[0].metadata.text_as_html)
|
|
|
|
|
|
**Usage: API Parameters**
|
|
|
|
.. code-block:: bash
|
|
|
|
curl -X 'POST' \
|
|
'https://api.unstructured.io/general/v0/general' \
|
|
-H 'accept: application/json' \
|
|
-H 'Content-Type: multipart/form-data' \
|
|
-F 'files=@sample-docs/layout-parser-paper-with-table.jpg' \
|
|
-F 'strategy=hi_res' \
|
|
-F 'skip_infer_table_types=[]' \
|
|
| jq -C . | less -R
|
|
|
|
.. warning::
|
|
|
|
You may get a warning when the ``pdf_infer_table_structure`` parameter is set to **True** AND **pdf** is included in the list of ``skip_infer_table_types`` parameter. However, this function will still extract the tables from PDF despite the conflict.
|