Solving your ETL problems,
One question at a time

Striim is a real-time, streaming analytics and data integration platform. This allows analysis while data is “in-flight”.

Confluent is a data streaming platform based on Apache Kafka: a full-scale streaming platform, capable of not only publish-and-subscribe, but also the storage and processing of data within the stream.

Learn about the two different ways to convert a database into a data warehouse.

Kafka allows you to think big, without compromising on the stability, reliability and the high performance of your system.

Amazon Redshift is a data warehouse aimed at large scale analytics. Elasticsearch is a search engine. It is wonderful for full text search over the documents stored in it.

The are quite a bit of open-source ETL tools, and most of them have a strong Python client libraries, while providing strong guarantees of reliability, exactly-once processing, security and flexibility.

When you are using a third-party ETL pipeline-as-a-service they take care of keeping your Redshift cluster clean and healthy. But in case you need to manage it on your own, you need to keep in mind the importance of Vacuum and Analyze operations.

Apache Kafka is definitely a wonderful tool for serving as the basis for a stream processing pipeline.

IBM introduced Infosphere Information Server as a complete set of business intelligence and data warehousing products which operate in four functional areas

CloverETL is a data transformation and data integration tool (ETL) distributed as commercial open source software.

{{answer.description}}