-
- Dev Rel
Kafka® Connect and Elasticsearch™ vs. PostgreSQL® Pipelines: Final Performance Results (Pipeline Series Part 9)
In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect, and what does it look like in Superset. In Part 8, we ran some initial load tests and found out how the capacity of the original Elasticsearch pipeline compared with the PostgreSQL variant. These results were surprising (PostgreSQL 41,000 inserts/s vs. Elasticsearch 1,800 inserts/s), so in true “MythBusters” style we had another attempt to make them more comparable.
Learn MorePaul BrebnerOctober 18, 2021 -
- Dev Rel
Kafka® Connect and Elasticsearch™ vs. PostgreSQL® Pipelines: Initial Performance Results (Pipeline Series Part 8)
In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect, and what does it look like in Superset. In this blog, we run some initial load tests and find out how the capacity of the original Elasticsearch pipeline compares with the PostgreSQL variant.
Learn MorePaul BrebnerOctober 13, 2021 -
- Technical
Using Apache Superset to Visualize PostgreSQL® JSON Data (Pipeline Series Part 7)
In the last installment of the pipeline blog series, we explored writing streaming JSON data into PostgreSQL using Kafka Connect. In this blog, it’s time to find out if our fears of encountering mutant monsters in the gloom of an abandoned uranium mine were warranted or not. 1. What Is Apache Superset? What is Apache...
Learn MorePaul BrebnerSeptember 28, 2021 -
- Dev Rel
- Technical
Change Data Capture (CDC) With Kafka® Connect and the Debezium Cassandra Connector (Part 2)
Instaclustr Tech Evangelist Paul Brebner explores how Kafka sink connectors change data and how Debezium propagates database schema changes.
Learn MorePaul BrebnerAugust 11, 2021 -
- Dev Rel
- Technical
Change Data Capture (CDC) With Kafka® Connect and the Debezium Cassandra Connector (Part 1)
Change Data Capture has been around for almost as long as databases (I even wrote one for Oracle in the 1990s!), and is any approach used to capture changes in one database to propagate to other systems to reuse (often other databases, but not exclusively).
Learn MorePaul BrebnerAugust 04, 2021 -
- Technical
Streaming JSON Data Into PostgreSQL® Using Open Source Apache Kafka Sink Connectors (Pipeline Series Part 6)
Having explored one fork in the path (Elasticsearch and Kibana) in the previous pipeline blog series, in this blog we backtrack to the junction to explore the alternative path (PostgreSQL and Apache Superset). But we’ve lost our map (aka the JSON Schema)—so let’s hope we don’t get lost or attacked by mutant radioactive monsters.
Learn MorePaul BrebnerJuly 22, 2021 -
- Technical
Unlocking the Full Potential Of PostgreSQL® JSON
In this blog we’ll answer the most commonly asked questions about the use of PostgreSQL JSON data type to help you unlock its full potential.
Learn MorePaul BrebnerJune 07, 2021 -
- Technical
The PostgreSQL® Boolean Three-Valued Logic Data Type
In my previous PostgreSQL blog, we discovered what data types are available in PostgreSQL (a lot) and hopefully determined the definitive mapping from PostgreSQL to SQL/JDBC to Java data types. However, even armed with this information you have to be careful about type conversion/casting, and watch out for run-time errors, truncation, or loss of information.
Learn MorePaul BrebnerJune 01, 2021 -
- Technical
PostgreSQL® Data Types: Mappings to SQL, JDBC, and Java Data Types
How do you use PostgreSQL from Java? With JDBC! (Java Database Connectivity). There’s a PostgreSQL JDBC Driver (PgJDBC for short) which allows Java programs to connect using standard, database independent, Java code. It’s an open source Pure Java (Type 4, which talks native PostgreSQL protocol) driver and is well documented.
Learn MorePaul BrebnerMay 24, 2021