CloverETL Engine
CloverETL is a Java-based data integration framework used to transform, cleanse, standardize and distribute data. Its component-based structure allows easy customization and embeddability.
Supported Platforms
Runs on both 32-bit & 64-bit platforms
- Windows
- Linux
- AIX
- Solaris
- HP-UX
- AS/400
- Mac OSX
- and many more
Supported Data Formats/Sources
- Natively supports all major industry standard databases
- Oracle
- MS SQL
- DB2
- Informix
- Sybase
- MySQL
- PostreSQL
- Other databases are supported through a JDBC layer
- Reads & writes
- XML data
- Excel (XLS) data
- Variable length data CSV
- Fixed-length data and several other not so common formats
- dBase/FoxBase/FoxPro
- FlashFiler
- Message Queues
- LDAP repositories
- Supports remote reading/writing of data through FTP/SFTP/HTTP/HTTPS protocols
- Also works with ZIPed & GZIPed data
- Integrates with middleware/messaging systems through JMS
- Contains connectors to WebServices using simple HTTP/S or SOAP protocols
Transformation of data
- Includes a palette of more than 40 specialized transformation components
(readers/writers/filters/joiners/aggregators/sorters/...)- Contains interpreter of specialized transformation language – CTL
- Transformations (mappings) of data can also be coded directly in Java or any other scripting language
- Offers 5 different look-up table types (Simple, Range, Database, Persistent, Aspell)
- Framework implements pipeline-parallelism – when a data record is processed by a component, it is immediately sent to the following component for additional processing.
- Internally represents all character data as Unicode – any character from any codepage can be represented – ASCII, LATIN, CYRILIC, ASIAN, etc.
- Converts data/strings from & to common character sets
(ASCII, UTF-8/16, ISO-8859-1, ISO-8859-2, CP-1250, etc.) - Data records are internally handled as variable-length data structures – can handle very large records (theoretical limit 231)
- Fields can have default values, text formats, NULL value checkers
- Supports string/date/time/integer/decimal/boolean/blob data types
Metadata
- Metadata describing structures of data (records) and transformations are natively stored in XML
- All metadata can be sorted in the common Source Code Management Systems – CVS, SVN, SourceSafe, etc