TextPipe Pro 8.3.5

TextPipe Pro 8.3.5 is an industrial strength text transformation workbench designed for data conversion and mining, electronic publishing and website maintenance; which is used by  more than1500 customers in 56 countries to:

• Convert between a variety of mainframe and PC data formats
• Fix data extracts
• Extract data from legacy databases
• Reformat and standardize electronic text and program source code
• Data Mine Unstructured Mainframe Reports and Online Web Data
• Split files or join files together
• Update web sites
• More customer uses for TextPipe  See demos  Screen shots
  

• Make multiple changes to multiple files in just one pass (eg 50 changes across 1 million files)
• Restrict changes to line or column ranges, Tab or CSV field ranges, lines matching a pattern, inside and between HTML tags and other criteria
• Fix text or binary files of any size - even files larger than 10 Gigabytes!

Major Features:

1. Process Information From Anywhere
   • TextPipe handles both text and binary files with equal ease. File formats you can convert and extract data from include:
   • • HTML, XML and other structured documents from the WWW
     • Fixed length, CSV (Comma-delimited), Tab-delimited, Pipe-delimited, *-delimited files
     • Unix, Macintosh, Mainframe and PC/Windows end-of-line formats
     • ASCII, ANSI, Unicode and EBCDIC files
     • Inside Zip files, and the new Microsoft Office 2007 formats DOCX, XLSX, PPTX
     • Rich Text Files (RTF)
     • Files with tagged data fields
     • Downloaded text files (e.g. news retrieval, financial, real estate)
     • EDIFACT, HL7 and other structured formats
     • Spooled print files
     • OCR output
     • Screen scrapes and captures
     • Structured and unstructured reports of any size or dimension
     • Email header, body and attachments (in conjunction with ResumePipe)
     • Framemaker MIF files and more.
   • Manipulate text and data files in an endless variety of ways
2. Lightning Fast Search and Replace
   • TextPipe offers a variety of powerful searches:
   • • Exact search (including multi-line and binary character search)
     • 'Sounds-like' search
     • Fuzzy search (great for finding typing errors)
     • Pattern or wildcard search
   • Search/replace lists and more.
   • The replacement text can include all or part of the original text or a re-arrangement of it, and the case of the replacement text can be automatically altered to preserve the case of the original text. The found text can be used as a constraint for further filters, such as by converting it to Upper Case, performing further search and replaces inside the replacement text or even a database or dictionary lookup.
3. Manipulate Precise Sections of Text
   • TextPipe can restrict changes to line ranges, column ranges, tab-delimited fields, CSV-delimited fields, lines matching a pattern and more. You can combine restrictions, for example, to alter a specific line and column range. You can also apply further text manipulations to the Replaced Text in a Search and Replace operation, such as by making the Replacement Text UPPERCASE.
4. Unlimited Power. TextPipe's frees you from worrying about memory size or disk space limitations:
   • TextPipe performs an unlimited numbers of manipulations in a single pass (e.g. 100 different search and replace operations)
   • There is no limit on file size - so you can process files larger than 10 Gigabytes
   • All files are processed without using temporary disk space - only the result file is output
   • TextPipe handles an unlimited number of files (e.g. corporate websites).
5. Manipulation Functions: TextPipe provides a huge range of filters for manipulating text. TextPipe's unmatched power comes from it's unique architecture and its tremendous flexibility in combining and arranging these filters to suit each task.
   • Filters to convert text:
   • • Convert between Unix, PC, Mac and Mainframe end of line and fixed width record formats. Conversion can detect incoming line feeds, and insert new characters such as line feeds between fixed-length records. Invalid End of Line characters can be automatically removed
     • Convert unprintable IBM drawing characters to + and | and -
     • Convert tabs to spaces or spaces to tabs
     • Convert character case to UPPERCASE, lowercase, tOGGLE cASE, Title Case, Sentence case, rANdoM cASE
     • Convert character collating sequence from ASCII to EBCDIC or EBCDIC to ASCII. Expand EBCDIC packed or zoned decimal, compress to EBCDIC packed or zoned decimal. Useful for handling mainframe files
     • Convert ASCII (Windows OEM) to ANSI and ANSI to ASCII. Useful with Windows and non-English languages
     • Convert CSV to Tab-delimited, CSV to XML
     • Convert Tab-delimited to CSV, Tab-delimited to XML
     • Convert text to a word list
     • Convert text to a Hex or Decimal dump (very useful for finding control characters)
     • Convert Word documents to text
     • Perform mathematical functions on characters (useful for custom ciphers)
   • Unicode functions:
   • • Conversions to and from 144 different Unicode formats, as well as ANSI/ASCII and a multitude of other formats
     • Convert Unicode to ANSI and ANSI to Unicode
     • Convert Unicode to ASCII and ASCII to Unicode
     • Swap UTF-16 word order, swap UTF-32 word order
     • Remove Byte Order Mark (BOM)
     • Make Big Endian, make Little Endian
     • Compose, Decompose and Normalize functions (NFC, NFD, NFKD, NFKC)
   • Filters to add text:
   • • Add line numbers, with control over the start number and increment, format, numbering of blank lines etc
     • Add left margin to the start of each line (e.g. to add reply quotes to email). The text can optionally come from an external file
     • Add right margin to the end of each line
     • Add header text to the start of each file
     • Add footer text to the end of each file
     • Add a column of text to every line at a specified column position
     • Add bytes to a file at a given position
     • Join two files side by side (repeating or non-repeating)
     • Word wrap text at a specified column width
     • Pad lines out with spaces to a specified column width (useful for generating fixed width records)
     • Truncate lines at a specified column width (useful for generating fixed width records)
     • Centre text in a specified column width
     • Right Justify text in a specified column width
     • Force lines to a specified column width (useful for generating fixed width records)
   • Filters to remove text:
   • • Remove blanks from start of line
     • Remove blanks from end of line
     • Remove blank lines
     • Remove multiple whitespace to a single space (useful for processing web pages)
     • Remove HTML, XML and SGML codes
     • Remove or resolve backspaces
     • Remove a line range
     • Remove lines matching or not matching a pattern
     • Remove lines from a list
     • Remove lines from a list of patterns
     • Remove duplicate lines
     • Remove lines or characters from the start or end of the file (like Unix head/tail)
     • Remove columns of text from each line
     • Remove delimited fields (CSV, Tab, Pipe etc)
     • Remove binary characters
     • Remove ANSI escape sequences
     • Remove all (used for its side effects)
   • Filters for email:
   • • Extract email address - for mailing lists, etc
     • Extract URLs and links (for web site spidering)
     • Remove email headers
     • ROT13 encoding/decoding
     • Hex encode/decode
     • MIME Base 64 encode/decode
     • MIME quoted printable encode/decode
     • UUencode/UUdecode
     • XXencode/XXdecode
     • HTTP encode/decode - useful with CGI scripts and web pages
   • Filters for special tasks:
   • • Search and replace - exact match, multi-line, sounds-like, fuzzy match (detects spelling mistakes), binary characters, perl and egrep patterns, MS Word patterns, Brief patterns, find inside HTML tags, find between HTML tags, find between any text. Lists of search/replace pairs can be loaded from Excel, CSV and Tab-delimited files
     • Extract matching text
     • Send text as a SQL command to an OLE DB/ODBC database and receive the results as CSV, fixed width, XML or database insert script, with or without header information (very handy for database extracts)
     • Sort lines. Options include ascending and descending ANSI and ASCII sort, sort by length of line, numeric sort, date/time sorts. The start column and length can now be specified. Handles files of unlimited size
     • Run an external program over the text
     • Run scripts written in VBScript, JScript or any scripting language
     • Comment filters to document the filter
     • Debug filter to show text at each point in the processing
     • Split files at a particular size, or after a particular character has appeared a defined number of times, or after a defined number of lines.
     • Join (merge) files together. e.g. Merge files to the clipboard.
     • Secondary output filters (a Unix T-filter) to output the text at different stages
     • Count duplicates or remove duplicates
     • Retain lines matching or not matching a pattern
     • Retain lines from a list
     • Retain lines from a list of patterns
     • Move columns or delimited fields (CSV, Tab, Pipe etc)
     • Copy columns or delimited fields (CSV, Tab, Pipe etc)
     • Repeat a file (duplicating its text)
     • Randomize line order - randomize lines in file
     • Reverse each line
     • Reverse line order
     • XSLT filter.
   • Filters to map single characters or Unicode characters to a new string:
   • • User-defined mapping. The user can specify a string to be output for each of the 256 possible character codes. Strings can contain embedded control characters. Unicode Maps are also supported.
     • UTF-16 maps
     • UTF-32 maps.
   • Filters to restrict changes to subsets of text:
   • • Restrict matching lines
     • Restrict non-matching lines
     • Restrict each line in turn (used for its side effects)
     • Restrict CSV fields
     • Restrict Tab fields
     • Restrict line range
     • Restrict column range
     • Restrict blocks
       
6. VBScript and JScript Custom Filters
   • Extend TextPipe by writing custom filters using industry-standard VBScript, JScript or other scripting languages. Use this to perform database lookups, insert data in Excel or Word or other non-standard processing. TextPipe can also call external programs to manipulate parts of the text.
7. Automation and Integration
   • TextPipe can be scheduled for automated lights-out processing, with audit logs tracking every step.
   • TextPipe can be automated via the command line (using the Command Line Wizard) or scripted via a COM interface, allowing TextPipe's text processing power to be controlled by programming languages such as Visual Basic, C++ and Delphi.
   • TextPipe can export filters to VBScript, JScript or a web page - which can be customized to make TextPipe even easier for less technical users by presenting a simplified GUI.
   • TextPipe integrates directly into Windows Explorer as a right-click menu for ease of use, and with a growing list of third party products.
8. Easy To Learn and Use. TextPipe includes many facilities to help get you started
   
   • Filter Wizard to walk you through creating your first filters
   • Extensive tutorials and lessons introduce you to key concepts
   • Test your filters without affecting key data files
   • Debug Filter to see what is happening
   • Comment Filter to document your process
   • Library of more than 200 example filter files
   • Online FAQ (Frequently Asked Questions)
   • Online demonstrations for common tasks
   • Online discussion group where you can ask questions and talk with other TextPipe users
   • Windows 95, 98, ME, NT, 2000, XP, 2003 Server, Vista and Vista 64.

Enhancements:

•  Fixed memory leak,
• VBScript/JScript code generation,
• Blank field handling