pdf parsing doesn't handle multi-column papers correctly

[markenki]

In readers.py, the text extracted from multi-column pdf documents doesn't respect columns, i.e., the text continues across columns. To fix this, the following line:

text = page.get_text("text", sort=True)

should be replaced by these lines:

# Extract text blocks from the page
blocks = page.get_text("blocks")
# Concatenate text blocks, which are already in the correct order, into a single string
text = "\n".join(block[4] for block in blocks)

I'd submit a pull request, but it seems I don't have sufficient permissions to do so.

Thanks!

[jamesbraza]

You can make a fork and open a PR into this repo. If you do make a PR, try to include a sample PDF or text file in tests/stub_data that repro's the issue.

[markenki]

Thanks, @jamesbraza! I just submitted a PR. I hope I did it correctly!

[jamesbraza]

@markenki did your PR (#938) resolve this issue? Or is there more to be done here