KETL – production ready ETL platform

KETL is a production ready ETL platform. The engine is built upon an open, multi-threaded, XML-based architecture.

KETL is designed to assist in the development and deployment of data integration efforts which require ETL and scheduling. The software allows management of complex manipulation of data quickly and efficiently while leveraging an open source data integration platform.

The KETL engine consists of a multi-threaded server that manages various job executors. Each executor performs a specific function. The job executors fall into the following categories: SQL, OS, XML, Sessionizer and Empty.

Features include:

  • Scalable, platform independent ETL engine–enables complex ETL transformations to be executed in a highly efficient manner. Supports multiple CPU’s and 64-bit servers.
  • Job execution and scheduling manager–dependency-driven job execution model supports multiple job types, conditional exception handling, email notification and time-based scheduling. Job types fall into three categories, with support for additional executors via the KETL API.
  • SQL–executes pre-defined SQL statement via JDBC.
  • XML–executes XML defined jobs.
  • OS–executes an operating system command.
  • XML job definition language–allows ETL jobs to be easily defined in XML, enabling the use of widely available XML authoring tools and associated support for version control systems.
  • Centralized repository–supports multiple KETL instances to leverage job and parameter definitions.
  • Performance monitoring–collects historical and active job statistics in the repository, allowing comprehensive analysis of problematic jobs.
  • Comprehensive data source support–supports extracting and loading of relational, flat file and XML data sources, via JDBC and proprietary database APIs.
  • Scheduling engine–time-based and event-driven job execution.
  • Support for integration of security and data management tools.
  • Proven scalability across multiple servers and CPU’s and any volume of data.
  • No additional need for third party schedule, dependency, and notification tools.

Website: sourceforge.net/projects/ketl
Support:
Developer: Kinetic Networks, Inc
License: GNU LGPL & GPL

KETL is written in Java. Learn Java with our recommended free books and free tutorials.

Return to Data Warehouse Software Home Page


Ongoing series
Linux for StartersNew to Linux? Read our Linux for Starters series.
Free and Open Source SoftwareThe largest compilation of the best free and open source software in the universe. Supplied with our legendary ratings charts.
Linux ReviewsHundreds of in-depth reviews offering our unbiased and expert opinion on software.
Alternatives to GoogleAlternatives to Google's Products and Services examines your options to migrate from the Google ecosystem with open source Linux alternatives.
MicrosoftAlternatives to Microsoft's Products and Services recommends open source Linux software.
Linux System ToolsEssential Linux system tools looks at small, indispensable utilities, useful for system administrators as well as regular users.
Linux ProductivityLinux utilities to maximise your productivity. Small, indispensable tools, useful for anyone running a Linux machine.
Home Computer EmulatorsHome computers became commonplace in the 1980s. Emulate home computers including the Commodore 64, Amiga, Atari ST, ZX81, Amstrad CPC, and ZX Spectrum.
Now and ThenNow and Then examines how promising open source software fared over the years.
Linux at HomeLinux at Home looks at a range of home activities where Linux can play its part, making the most of our time at home, keeping active and engaged.
Linux CandyLinux Candy opens up to the lighter side of Linux. Have some fun!
Best Free Android AppsBest Free Android Apps. There's a strict eligibility criteria for inclusion in this series
Programming BooksThese best free books accelerate your learning of every programming language
Programming TutorialsThese free tutorials offer the perfect tonic to the free programming books series
Stars and StripesStars and Stripes is an occasional series looking at the impact of Linux in the USA
Share this article

Share your Thoughts

This site uses Akismet to reduce spam. Learn how your comment data is processed.