Previous versions limited the total file size to 2GB. DADiMP 6.7
uses a 64 bit file index to enable handling of very large files.
Although each individual series in a file is limited to 2GB,
the total file size is now essentially unlimited
(file sizes in the
terabytes). Thus, a data file can now contain any number of series
where each series can be up to 2GB in length.
In addition, previous versions of DADiMP import series one at a
time, creating overhead in large interlaced files where DADiMP
would take a separate pass through the data file for every series
imported. DADiMP 6.7 keeps header info and buffers for as many
series as possible and imports all of them in a single pass through
the file, greatly improving performance on large interlaced files.
Because the DADiMP code base is fully integrated with DADiSP, all
new header keywords supported by DADiSP are automatically supported
by DADiMP 6.7, including byte swapping, integer byte size, binary data
types, date/time formats and dozens of others to simplify the
importing of 3rd party ASCII and binary file formats.
DADiMP 6.7 New Features Summary
- 64 Bit File Index supports Terabyte File Sizes
- Optimized ASCII and Binary Interlaced Data Importing
- Full DADiSP Header Format and Keyword Support
- Number of Importable Columns Limited only by Memory Size