how to extract text from double lines pdf - python

I have some pdf files, which have double columns per page. I want to extract text from those files by program. The content of pdf file is Chinese. I tried to use pdfminer3k library of python3 and ghostscript, whose result are all not very good.
At last, I use the github open source project named textract, and the link is deanmalmgren/textract.
But textract can not detect that the every page that contains two columns. I use the following command:
import textract
text = textract.process("/home/name/Downloads/textract-master/test.pdf")
print text
And pdf file link is https://pan.baidu.com/s/1nvLQnLf
The output result shows that the extract program regards the two columns as one column. I want to extract the double columns pdf files. How to solve?
This is the output result by extract program.

Related

Parse pdf extraction into csv file with Python

I am still a newbie to Python. I am trying to develop a generic pdf-scraper to csv that is organized by the columns containing: page number and paragraphs.
I'm using the PyMuPDF library and I have managed to extract all the text. But I have no clue how to parse the text and write it into csv:
page number, paragraph
page number, paragraph
page number, paragraph
Luckily there is a structure. Each paragraph ends with an enter (\n). Each page ends with a page number followed by an enter (\n). I would like to include headers as well but they are harder to delimit.
import fitz
import csv
pdf = '/file/path.pdf'
doc = fitz.open(pdf)
for page in doc:
text = page.getText(text)
print (text)

pdftotext return blank but pdf has multiple lines and multiple pages why?

import pdftotext
# Load your PDF
with open("docs/doc1.pdf", "rb") as f:
docs = pdftotext.PDF(f)
print(docs[0])
this code print blank for this specific file, if i change the file it is giving me result.
I tried even apache Tika. Tika also return None, How to solve this problem?
One thing I would like to mention here is that pdf is made of multiple images
Here is the file
This is sample pdf, not the original one. but i want to extract text from the pdf something like this

pdfminer odd result with a two columns pdf

I'm converting somes pdf documents to text and for it I'm using pdfminer (using pdf2txt.py). I'm not converting directly from pdf to txt, because I want to signal formats such as italics or bold. Therefore I first convert the pdf to xml.
I'm converting pdf to xml using:
pdf2txt.py -t xml -o out_file.xml in_file.pdf
My problem is that I found an odd error in the xml file when converting this pdf. If you convert it to xml, check the following:
In page 21 of the pdf the second column starts with "Recentemente...".
The first paragraph of the first column (of the same page) ends with "...lhes falta".
The resulting converting xml file contains the item 1. (and full column) just after item 2. You can check it in line 128370 of the xml file. Then in line 131782 the correct order starts again, i.e., the paragraph that starts with "O terceiro..." follows.
So, my question is if there is a solution to avoid this error.

Splitting PDF files into Paragraphs

I have a question regarding the splitting of pdf files. basically I have a collection of pdf files, which files I want to split in terms of paragraph. so to each paragraph of the pdf file to be a file on its own. I would appreciate if you can help me with this, preferably in Python, but if that is not possible any language will do.
You can use pdftotext for the above, wrap it in python subprocess. Alternatively you could use some other library which already do it implicitly like textract. Here is a quick example, Note: I have used 4 spaces as delimiter to convert the text to paragraph list, you might want to use different technique.
import re
import textract
#read the content of pdf as text
text = textract.process('file_name.pdf')
#use four space as paragraph delimiter to convert the text into list of paragraphs.
print re.split('\s{4,}',text)

Importing Text Files To Python And Spintax Then Outputting Text

I'm stuck on how to accomplish this. What I have is a folder of say 10 text files and in each text file is a article done in spintax, example: {This is|Here is} {My|Your|Their} {Articles|Post}
Each text file contains a full article with paragraphs in spintax. What I'm wanting to do is randomly grab from that folder one article, spin it off the spintax and then output/save it as a new text file or append to file.
I've tried to find some examples of how to do this but have had no success.

Categories