{"id":7414,"date":"2012-04-29T10:53:31","date_gmt":"2012-04-29T14:53:31","guid":{"rendered":"http:\/\/scruss.com\/blog\/?p=7414"},"modified":"2014-07-13T14:15:14","modified_gmt":"2014-07-13T18:15:14","slug":"my-bank-broke-pdf-and-how-i-used-pdfbeads-to-fix-it","status":"publish","type":"post","link":"https:\/\/scruss.com\/blog\/2012\/04\/29\/my-bank-broke-pdf-and-how-i-used-pdfbeads-to-fix-it\/","title":{"rendered":"My bank broke PDF … and how I used PDFBeads to fix it"},"content":{"rendered":"

I’m on a major decluttering toot. When I realised that the filing cabinet I bought three years ago would no longer close with all the papers stuffed in it, I knew something had to change. I’ve been shredding like it’s Houston in 2001<\/a>. I have the duplex scanner<\/a> to suck in the stuff I need to keep. I’m moving to paperless wherever possible to stop it building up again.<\/p>\n

My bank<\/a> provides PDF statements. Of this I approve. PDF is almost perfect for this: it provides an electronic version of the page, but with searchable text and the potential for some level of security. Except, this is not the way that my bank does it. At first glance, the text looks pretty harmless:<\/p>\n

\"\"<\/p>\n

Zoom in, and it gets a bit blocky:<\/p>\n

\"\"<\/p>\n

Zoom right in:<\/p>\n

\"\"<\/p>\n

Aargh! Blockarama! Did they really store text as bitmaps? Sure enough, pdftotext output from the files contains no text. Running pdfimages produces hundreds of tiny images; here’s just a few:<\/p>\n

\"\"\"\"\"\"\"\"\"\"\"\"<\/p>\n

Dear oh dear. This format is the worst of electronic, combined with paper’s lack of computer indexability. The producer claims to be Xenos D2eVision<\/a>. Smooth work there, Xenos.<\/p>\n

So, how can I fix this? It’s a bit of a pain to set this workflow up, but what I’ve done is:<\/p>\n

    \n
  1. Convert the PDF to individual TIFF files at 300 dpi. Ghostscript<\/a> is good for this:
    \ngs -SDEVICE=tiffg4 -r300x300 -sOutputFile=file%03d.tif -dNOPAUSE -dBATCH -- file.pdf<\/code><\/li>\n
  2. Run Tesseract OCR<\/a> on the TIFF files to make hOCR<\/a> output:
    \nfor f in file*tif
    \ndo
    \ntesseract $f `basename $f` hocr
    \ndone<\/code><\/del>
    \nUpdate<\/strong>:     Cuneiform<\/a> seems to work better than Tesseract when feeding pdfbeads:
    \nfor f in file*tif
    \ndo
    \ncuneiform -f hocr -o `basename $f .tif`.html $f
    \ndone<\/code><\/li>\n
  3. Move the images and the hOCR files to a new folder; the filenames must correspond, so file001.tif needs file001.html, file002.tif file002.html, etc.<\/li>\n
  4. In the new folder, run pdfbeads * > ..\/Output.pdf<\/code><\/li>\n<\/ol>\n

    The files are really small, and the text is recognized pretty well. It still looks pretty bad:<\/p>\n

    \"\"<\/a>but at least the text can be copied and indexed.<\/p>\n

    This thread \u00e2\u20ac\u0153Convert Scanned Images to a Single PDF File<\/a>\u00e2\u20ac\u009d got me up and running with PDFBeads. You might also have success using the method described here: \u00e2\u20ac\u0153How to extract text with OCR from a PDF on Linux?<\/a>\u00e2\u20ac\u009d \u00e2\u20ac\u201d it uses hocr2pdf<\/a> to create single-page OCR’d PDFs, then joins them.<\/p>\n","protected":false},"excerpt":{"rendered":"

    I’m on a major decluttering toot. When I realised that the filing cabinet I bought three years ago would no longer close with all the papers stuffed in it, I knew something had to change. I’ve been shredding like it’s Houston in 2001. I have the duplex scanner to suck in the stuff I need […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[7],"tags":[1600,2496,1752,2495,1161,765,2497,807,2822],"class_list":["post-7414","post","type-post","status-publish","format-standard","hentry","category-computers-suck","tag-bank","tag-declutter","tag-hsbc","tag-ocr","tag-paper","tag-pdf","tag-pdfbeads","tag-scan","tag-tesseract"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pQNZZ-1VA","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/posts\/7414","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/comments?post=7414"}],"version-history":[{"count":7,"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/posts\/7414\/revisions"}],"predecessor-version":[{"id":10877,"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/posts\/7414\/revisions\/10877"}],"wp:attachment":[{"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/media?parent=7414"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/categories?post=7414"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scruss.com\/blog\/wp-json\/wp\/v2\/tags?post=7414"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}