CloverETL Engine Changelog

What's new in CloverETL Engine 3.5.0

Jan 23, 2014
  • CloverETL 3.5 brings a brand new Data Quality package, including a very useful Validator component. There are also a number of improvements on the Server front - usability and monitoring improvements come along with enhanced management of the Cluster, and there are some neat new perks for administrators as well.

New in CloverETL Engine 3.5.0 Milestone 2 (Nov 1, 2013)

  • This second milestone release of CloverETL 3.5.0 adds a validator component, encrypted parameters, a JSONExtract component, improved Server health monitoring, and improved Server usability.

New in CloverETL Engine 3.4.2 (Sep 20, 2013)

  • This version fixes bugs, improves graph-to-HTML exportation, initializes the EmailSender connection to an SMTP server in a specific phase, and upgrades the JSch library to 0.1.50.

New in CloverETL Engine 3.4.0 (May 16, 2013)

  • This version contains all the features of its 2 milestones and more.
  • Only one cluster node needs a connection to server database; other nodes will connect through it.
  • There is a ClusterSimpleCopy component and improved visualization of errors in the graph log.
  • HTTPConnector supports PUT and DELETE methods.

New in CloverETL Engine 3.4.0 Milestone 2 (Mar 22, 2013)

  • Designer DB connections proxied through Server.
  • A new server Web interface, an ExecuteMapReduce component, repartitioning and improved cluster tracking, XSLT2.0 in XSLTransformer, Weblogic 12c support on Server, additional usability improvements of Designer, and improved Profiler integration with Server.

New in CloverETL Engine 3.3.1 (Jan 31, 2013)

  • Tracking is reported in % (e.g. now it's "30%" vs the previous "0.3"). XMLExtract: autofilling did not work.
  • SystemExecute will not delete a temp file if the component fails.
  • Recapacity of CloverBuffer was not allowed.
  • The CTLUtils class could not be used in transformations.
  • Incorrect last modification date on SFTP has been fixed.
  • The org.jetel.license dependency has been removed from the org.jetel.component plugin.

New in CloverETL Engine 3.4.0 Milestone 1 (Dec 20, 2012)

  • Precise cluster allocation, dynamic load balancing in graphs and cluster, big data support via Hadoop hdfs and Hive, Data Profiler integration on the server, and usability improvements in Designer.

New in CloverETL Engine 3.3.0 (Oct 22, 2012)

  • This release brings new capabilities for orchestrating processes and workflows, much improved cloud connectivity and powerful Data Profiler are now integrated into the platform.

New in CloverETL Engine 3.1.2 (Oct 14, 2011)

  • Customization options for OEM partners.
  • Minor XMLWriter tweaks.
  • The file URLs form has been changed to be Java compliant.
  • A bug in the XMLExtract mapping editor has been fixed: it preserves the mapping of items mapped by ../ notation.

New in CloverETL Engine 3.0.2 (Mar 31, 2011)

  • CTL2: lists and maps of records are now possible.
  • XMLExtract now distinguishes between null and empty strings.
  • Aggregate: avg() and sum() aggregate functions now perform integer overflow check.
  • DataIntersection correctly reports unsorted input now.
  • UniversalDataReader and Writer now support the "Quote character" attribute for specifying.
  • There are additional fixes.

New in CloverETL Engine 3.0.1 (Nov 16, 2010)

  • The error ports of UniversalDataReader and LDAP Reader can also have byte/cbyte fields instead of just strings.
  • XMLExtract failing on opening input files in multiple phases has been fixed.
  • Recursive parameter definition is now properly detected and warned in the log.
  • CTL2 for cycle consuming memory has been fixed in CTL2 interpreted mode.
  • byte and cbyte types in CTL2 are now fully compatible.
  • ByteBufferUtils.encodeLength(ByteBuffer, int) has been fixed for 5-byte lengths.

New in CloverETL Engine 3.0.0 (Aug 25, 2010)

  • New Generation of CTL Language – “CTL2”
  • Distributed Transformation Processing
  • Data Dictionary full support in Designer
  • Fact Table Load Wizard
  • Server Modularity through OSGi

New in CloverETL Engine 2.9.5 (Aug 24, 2010)

  • This is a maintenance release.

New in CloverETL Engine 2.9.3 (Jun 4, 2010)

  • This release fixes an incorrect resolution of special characters in transforms specified by URL and a server thread recycling bug.

New in CloverETL Engine 2.9.0 (Jan 30, 2010)

  • Infobright Data Writer:
  • In response to customer requests, this component writes data into Infobright software, a column-oriented relational database. Infobright is a provider of solutions designed to deliver a scalable data warehouse optimized for analytic queries.
  • Web Services component:
  • The new component makes communication with Web Services easier than ever. It provides user friendly graphical interface for mapping your data into Web Service fields, automatically generates requests and process responses. It offers faster, easier and more comfortable way to interact with remote Web Services.
  • Reading formatted values from XLS:
  • Additionally to reading plain data from MicrosoftTM ExcelTM sheets, the Excel component is now also capable of reading user-formatted values such as currencies, dates or numbers.
  • New tracking option:
  • Customers can now see all absolute speed rates for finished data transformations, facilitating comparative analysis in pursuit of process improvements.
  • New Aspell Lookup table:
  • Brand new implementation of this component brings better performance, improved configuration and better customization.
  • Improved treatment of empty (NULL) values:
  • Developers can now specify special strings that should be treated as empty (NULL) when data is being parsed. This feature simplifies processing of typical application export files which often contain values insignificant for ETL processing. Additionally it may lead to improved processing throughput and lower memory consumption of data transformation.
  • More user friendly File URL dialog and improved LDAP functionality.

New in CloverETL Engine 2.7.2 (Oct 22, 2009)

  • This version adds an optimized UniversalDataReader, Trash print ID, unification in treating null and empty fields in many components (Dedup, etc.), a -skipcheckconfig runtime option, and the ability to include comments in SQL queries.

New in CloverETL Engine 2.7.1 (Jun 3, 2009)

  • Features:
  • added CTL functions: bit_and bit_or, bit_xor
  • StringAproxComparatorLocaleRules for more languages
  • Clover-to-SQL conversions have been revised for all supported dbms, some data types changed
  • performace improvement in HashJoin
  • Fixed:
  • multiple XPathReaders in one graph with different namespaces
  • writing data to port doesn't use unnecessary threads
  • updated our built-in mysql driver to version 5.1.17
  • DBExecute - NPE when executing stored procedure in Oracle, which have output parameter as not the first paramete
  • when query in DBInputTable finishes with ; strange error is thrown
  • OracleDataWriter leaves junk after execution
  • randomSeed doesn't work in DataGenerator
  • edit_distance function with strength 2
  • ExtSort with a locale
  • other fixes

New in CloverETL Engine 2.7.0 (Apr 24, 2009)

  • DataGenerator can use CTL function to generate random data, lookup table may be used
  • added support for XLSX format to both XLSReader and XLSWriter
  • new CTL functions
  • str2num ctl function has new pattern and locale parameters
  • added support for formatting of date/time fields using the Joda Time syntax
  • CloverDataReader can read multiple files
  • Tar protocol support for readers
  • xmlFeatures attribute for XMLExtract and XPathReader components
  • Skip and Number Records is implemented also for every source
  • XMLExtract has new numRecords and skipRecords in the mapping attribute
  • autofilling for DBInputTable and XMLExtract
  • autofilling has new attributes row_timestamp and reader_timestamp
  • better checkConfig for data record metadata
  • readers supports wildcards in archives
  • DBExecute can read statements from input port
  • bulkloaders use named pipes for data transfers when possible
  • new implementation of JdbcSpecific - DefaultConservativeJdbcSpecific
  • OracleSpecific has new attribute rowPrefetch (value can be changed in defaultProperties)
  • new JDBC specific for MSSQL 2005
  • edge debug can log up last N records
  • graph parameters are printed out by logger on debug level
  • MergeJoin finishes as soon as no slave data records are available (in case of inner join)
  • Merge runs and displays a warning if only a single input is connected
  • locale and date/number formats can be specified for an entire data record
  • "description" property added to both data record and data field meta data
  • "recordKey" property added to data record metadata
  • clover and clover.bat shell scripts now return a value specifying success/failure
  • added shell scripts for AnalyzeDB and DBFAnalyzer
  • BadDataFormatException returns also wrong value for parsers
  • XMLExtract has better error handling