Release Log

This article includes a log of recent significant changes to the Instaclustr Managed Service.

Table of Contents

August 2021

4 August
  • Corrected the multi-DC Cassandra provisioning API example.

3 August
  • Added a new endpoint for users to rotate their own API key
  • Repositioned settings and support menus in Console 2
  • Managed ZooKeeper clusters can now be managed completely in our new console, with monitoring, firewall management and connection support all now available
  • Console 2 UI improvements for smaller screens
  • Add additional nodes sizes with larger disks to the Open Distro for Elasticsearch offering on Azure with Availability Zones.

2 August
  • AWS Graviton 2 and GP3 support for our Kafka offering
  • Provisioning support is discontinued for older Kafka versions: 2.1.1, 2.3.1 and 2.4.1
  • Boost sizes introduced for Kafka

July 2021

29 July
  • Spark landing page available on Console 2.

28 July
  • Added support for creating PCI-enabled Elasticsearch cluster on Console 2
  • Standardised Console 2 Table Layouts
  • Various UI Improvements to Console 2

26 July
  • Moved Shotover connection info to a separate tab on Console 2’s Connection Info page.
  • Fixed a Console 2 bug showing the incorrect number of nodes in the summary section of the Add Nodes page.
  • Added the L8s_v2-an node size to the Central US region for the Azure provider.

21 July
  • Fixed developer node sizes being available for Private Network Clusters when they should not have been. The exception is the “t3.medium-v2-tls” node size which is available for Apache Cassandra.
  • Changed the Create Cluster button on Console 2
  • Updated the search button on Console 2 to be clearable once there is an active search. Also added a hover effect to buttons.
  • Added Reset Password functionality to Console 2
  • Emails related to free trial expiry and user access expiry are now compatible with Console 2.
  • Fixed an issue with the Confirm Password fields used on various Console 2 pages not forcing passwords to match.

20 July
  • Fixed incorrect provisioning information when cdc is in the joining status.

15 July
  • Added Zendesk chat to Console 2.

13 July
  • Added support for linking users to accounts on Console 2.

12 July
  • Added a warning when attempting to create a Kafka Connect cluster targeting a PCI compliant Instaclustr managed cluster.
  • API users can now add Cluster Data Centre for Cassandra and Redis clusters.
  • Cassandra and Redis Data Centres can now be added through Console 2.
  • Added automatic sign in to support portal when navigating from Console 2.
  • Added a new AWS instance type to London region.

8 July
  • Add nodes is now available for Redis clusters in Console 2.
  • Redis cluster connection info page updated to include per-data centre instructions.

6 July
  • Users can now sign up and verify their emails through Console 2.
  • Updated the pricing display on Console 2 for accounts using their own AWS accounts.
  • Improved the On-Premises Kafka Dedicated Zookeeper selection experience on Console 2.
  • Updated Redis API to return Redis password authentication and client encryption.

5 July
  • API keys page was updated to mask the credentials after the initial generation.
  • Azure Backups are now enabled for on-premises users.

1 July
  • Kafka Users with the SASL/SCRAM SHA-512 Authentication Mechanism can now be created within our updated Console
  • Improved node status display and cluster status polling on Console 2

June 2021

30 June
  • Added support for Azure Availability Zones.
  • Added VPC peering feature (AWS only) to Console 2.

29 June
  • Updated metrics graph and list page with more accurate labels for the help link and metrics dropdown.

28 June
  • Account Security Settings page is now available for Console 2.
  • Added OpenID Connect (OIDC) CRUD support for clusters on Console 2.
  • Kafka users can now be created with the SHA-512 SASL/SCRAM mechanism, as well as the preexisting SHA-256 mechanism; see our API documentation for details.

24 June
  • Fixed an issue with Azure RIYOA provisioning.

22 June
  • To ensure the security of accounts, we now require emails to be revalidated every 180 days.

21 June
  • Added ‘Create account’ feature on Console 2.
  • Added ‘Summary Metrics’ for Console 2.
  • Improved the EBS encryption key selection experience on the create cluster page on Console 2.

17 June
  • Updated Console 2 styles and fixed missing on premises node size.

16 June
  • Made two new AWS node sizes available for Managed Zookeeper, which all offer Local SSD storage.

10 June
  • Classified t3.medium-v2-tls as developer only node size

09 June
  • Released an all new version of the Instaclustr Console! Console 2 is now available as a preview, and will be displayed as a link through the original Console.
  • Users can set up and revoke MFA on Console 2.

08 June
  • Released version v5.0.4 for Kafka Schema Registry.

02 June
  • Updated the View External Identity Provider page on the Console to provide custom domain based ACS URL.
  • Added new AWS Graviton node sizes for Redis.

May 2021

 

28 May
  • Fixed a bug where logging into console with different permutations of lowercase and uppercase in username or email could cause an error

27 May
  • Updated the SCIM User Management deactivate user endpoint to completely deactivate the user from Instaclustr.
  • Fixed a bug when querying some metrics in prometheus format returning 400 Error.

25 May
  • Enabled automated provisioning of Multi DC Clusters when created via the api

19 May
  • The user-provided data centre name for multi-DC provisioning is now available via the Cluster Read API.
  • Updated data centre JOINING status so it can only be reached after the PROVISIONED status

18 May
  • Customer are now able to identify the Storage Type used by each node type for all 3 providers.
  • The Storage Type is now displayed in the Create Cluster and Pricing Pages as-well.
  • Fixed display bug in console for Redis Mirroring clusters

13 May
  • Firewall rules for Kibana on Elasticsearch clusters can now be created and deleted using the respective APIs.
  • Fixed a bug when creating Kafka Connect Mirror with “Rename mirrored topics” unticked that causes creation to be failed.

10 May
  • Updated API to return login details for any type of cluster

06 May
  • Released Cassandra 4.0 rc1 as a preview version.
  • We are supporting managed Apache ZooKeeper as one of our new offering.
  • Made four new GCP node sizes available for Managed Kafka, which all offer Local SSD storage.

05 May
  • Provisioning API will now return nodes in rack, then ID order to ensure consistency out output.

04 May
  • Private network cluster support is now enabled for On-premises.

03 May
  • Added additional metrics for Redis Mirroring

April 2021

29 April
  • Fixed an issue that rollup metrics are not available for a period larger than 1 hour.
  • Updated the Dashboard to display the Storage Type used for a particular Node Size

28 April
  • Update api to be able to provision multiple Apache Cassandra data centres in a single request

22 April

12 April
  • Fixed an issue that allowed cdc resizes to target non Kafka node sizes if the Kafka cluster had add-ons enabled.

March 2021

30 March
  • Updated connection info page to link to Cassandra C# connection support page.
  • Updated Redis hard memory limit on Docker for nodes.
  • Enabled accelerated network node sizes for Cassandra and Elasticsearch.

29 March
  • Enabled support for CounterMutationStage and ViewMutationStage metrics for Cassandra 4.0.
  • Updated terraform-description API endpoint to support multiple add-on bundles and DCs

24 March
  • Fixed an issue where clusters would not show up in the console when there is at least one multi-DC cluster in the account.

23 March
  • Added AWS_VPC tags to the Cluster Status API call and Console cluster details and cluster list view.

22 March
  • Released Spark 3.0.1 for Cassandra 4.0-beta2 preview.

17 March
  • Disabled zeppelin for api requests
  • Enable c5d.2xlarge in AWS, SA_EAST_1

16 March
  • Updated Redis Monitoring API and API Docs
  • Added Redis replica nodes will now be assigned to an optimal Redis master
  • Increased validations on Custom Connector Storage Configurations at provisioning time, and introduced fixes to allow Configurations including keys that contain ‘=’ characters.

11 March
  • Deprecated Kafka AWS node sizes r5.xlarge-750-gp2 and c5.xlarge-750-gp2. Introduced Kafka AWS node sizes r5.xlarge-800-gp2 and c5.xlarge-800-gp2.

10 March
  • Two new node size r5xl-800-v2 and m5l-400-v2 added for Elasticsearch.
  • Added support for UAE North Azure region

9 March
  • Updated Provisioning API terraform-description endpoint to include cluster’s provider information.
  • Fix certificate compatibility issue affecting .NET Cassandra clients on Windows.
  • New data centre level instance resize feature (within same disk sizes) for AWS Elasticsearch and Kafka clusters.
  • Updated Redis config with optimisation settings.

4 March
  • Updated Calculation of Cassandra seed nodes so replacing a node in a private IP cluster and deleting the current data will trigger data streaming.

3 March
  • Azure local storage supported node size Standard_L8s_v2 is now available with Accelerated Networking

2 March
  • Fixed issue with Cassandra and Elasticsearch clusters being unable to manually start a backup from the Console.

1 March
  • Added Kafka 2.6.1 and Kafka Connect 2.6.1
  • Added Backup/Restore capabilities to Redis Clusters on the console.

February 2021

24 February
  • Hardened Spark Docker image.

19 February
  • Fixed a bug where overlapping CIDRs in Firewall Rules could not be added via API.

16 February
  • Implemented additional feature to show the replica(s) of each Redis Master Node.
  • Exposed Produce / Fetch bandwidth quota per user metrics for Kafka, this functionality will be enabled as the changes are rolled out.

15 February
  • Updated Kernel settings for Redis nodes.

12 February
  • Added AWS Restore capabilities for Redis Clusters.

10 February
  • Fixed an issue where unsupported application versions could be provisioned as PCI compliant.

9 February
  • Continuous backup add-on enabled for Cassandra 4.0 preview

4 February
  • Improved Redis ACL support

2 February

January 2021

28 January
  • Reduced default Debezium logging level.

22 January
  • Fixed Kafka PCI Addon selection and client encryption default setting (true)

21 January
  • Updated Redis Provisioning API and API Documentation

20 January
  • Implemented additional validation rules for Kafka Connect provisioning

18 January
  • Redis – Streamlined defaults for cluster creation and updated media
  • Fixed data center network, replication factor and node count values with GCP and Azure providers not re-populating with a failed create cluster form submission
  • Fixed clusters with default node sizes with GCP cluster provisioning with Kafka node sizes
  • Fixed create cluster form not persisting custom form values with invalid form submissions
  • Updated memory and disk size values for nodes on Create Cluster and Pricing & Features page

13 January
  • Fixed an issue where Kafka Connect custom connectors can’t be used in S3 buckets that only support SigV4

12 January
  • Added Content-Security-Policy and X-XSS-Protection headers to console requests
  • Minor bug fix in alerting on Redis clusters.
  • Fixed an issue where SSO users could not perform Redis user operations (create/ delete / change password).
  • Released Open Distro Elasticsearch 1.11.0.
    Released Open Distro Kibana 1.11.0.

11 January
  • Read and Write metrics for different Cassandra consistency levels are now available via the API and Console.

06 January
  • Released Redis 6.0.9.

05 January
  • Made changes to the ic-kafka-topics.sh tool so that topic creation will obey –if-not-exists flags.

04 January
  • Kafka Connect Clusters can now be provisioned targeting Clusters with pre-existing Security Group based firewall rules.
  • Improved reliability of Kafka synthetic metrics, this will be rolled out to clusters in a staged manner.

December 2020

17 Dec
  • Fixed the issue where SSO users can’t perform Kafka user operations (creating/deleting/changing password).
  • Fixed an issue where new users were unable to add data centres to their clusters through the Instaclustr Console.
  • Enhanced the login failure message shown when a user is locked out of their account after 5 consecutive unsuccessful logins if the security setting is enabled.
  • Enhanced the cluster creation page and the add DC page to suggest network ranges that do not overlap with other datacentres in the account.
  • Enabled kafka schema registry and kafka rest proxy password reset through terraform-provider-instaclustr.
  • Fixed an issue in terraform-provider-instaclustr where it didn’t wait for clusters to reach RUNNING state before creating the bundle users.

16 Dec
  • Filtered out IP addresses of ZooKeeper nodes from address lists in Kafka clusters’ Connection Info dashboard page.
  • Updated the welcome email to reflect our current offerings.
  • Made Debezium 1.3.1.Final available as a custom module.

10 Dec
  • Fixed a bug in the API documentation where brackets in example URIs are displayed as encoded strings.
  • On request node size i3.4xlarge node size changed from deprecated to standard.

9 Dec
  • Added support for managing Kafka mirroring setups to the provisioning API.
  • Fixed a console bug where a SSO only user can’t delete clusters.

8 Dec
  • Added ordering of API endpoints via a custom x-priority extension on the OpenAPI 3 specification.

7 Dec
  • Fixed incorrect provisioning API responses when using unauthorized API keys.

1 Dec
  • Deployed internal SSO mechanism
  • Fine-tuned Redis cluster SLA failure alerts

November 2020

30 Nov
  • Added mirroring source connector metrics on Console for Kafka Connect.
  • Password Authentication and Authorization with Client Node encryption is now enabled for Cassandra 4.0 (beta 2) Preview release

26 Nov
  • Released Cassandra 3.11.8.  Made Cassandra 3.11.4 and 3.11.6 disabled by default for new clusters.

23 Nov
  • We have retired deprecated AWS node sizes.

19 Nov
  • We have a new endpoint for monitoring API that returns paged results and we can now use wildcard for querying Kafka broker level topic metrics.

19 Nov
  • Fixed an issue in provisioning Kafka clusters with Kafka Rest Proxy bundle, through Instaclustr API.
  • Fixed an issue where more restrictive OpenSSL clients could not connect to clusters.

17 Nov
  • Fixed an issue where the Sign Up page would return a blank page.
  • Updated default configuration for Redis clusters

16 Nov
  • Implemented PCI enablement on SSO accounts.

12 Nov
  • Implemented cluster deletion for SSO only users.

11 Nov
  • Included Kafka schema registry and rest proxy password resetting feature through API

10 Nov
  • Upgraded deprecated imports

09 Nov
  • Safety checks implemented for Redis node replace operations

05 Nov
  • Simplified process and user interface for creating managed Kafka mirroring setups
  • Introduced a new API endpoint GET /provisioning/v1/{clusterId}/events to obtain information on cluster provisioning related errors

03 Nov
  • Enhanced responses from the Instaclustr API to include additional details on HTTP 500 errors.
  • Changed “Update the role of a user” endpoint to support SCIM username in the “scim_username” field.
  • Changed email arguments to be case insensitive with User Management API endpoints.
  • Simplified process and user interface for creating managed Kafka mirroring setups

02 Nov
  • Added option to not open up the Cassandra thrift port for user access, the cql port can now be opened without the thrift port.

October 2020

29 Oct
  • Implemented per customer rate limiting on monitoring API.

28 Oct
  • It is now possible to retrieve Kafka consumer group states through API https://developer.instaclustr.com/#operation/getKafkaClientsInConsumerGroupV2  and console https://www.instaclustr.com/support/documentation/kafka/monitoring-information/consumer-group-states.
    Please note that metrics might not be reported for your cluster as these metrics will be enabled gradually across clusters

27 Oct
  • Add support for the following AWS regions: af-south-1 (Cape Town), eu-south-1 (Milan), me-south-1 (Bahrain).

26 Oct
  • Removed provisioning limits for customer provider accounts (enterprise).
  • Fixed an issue on the console where 404s returned raw HTML.
  • Users can now request for SSO and obtain SAML 2.0 configuration details through the Instaclustr Console.

21 Oct
  • Fixed the issue that ickafka user’s password could not be reset immediately after the cluster reaches running state.

15 Oct
  • Added new custom heroku plan in Frankfurt with 6 i3en.xlarge nodes

14 Oct
  • Enable China region for contracted customers.

13 Oct
  • New Cassandra versions 2.1.22 and 4.0-beta2 have been released. 2.1.22 is only available upon request.

6 Oct
  • Added ‘Active Connector’ page in console for managing Kafka Connect connectors.

1 Oct
  • Kafka Rest proxy and Kafka Schema registry user passwords are now configurable through Dashboard kafka users view.
  • Added OpenID Connect (OIDC) support for Elasticsearch clusters to facilitate Single Sign-On (SSO) for Kibana.
  • Redis backup supported on Azure and GCP.

September 2020

30 Sep
  • Adding an EBS Encryption Key now requires the Provider Account to be specified. Existing EBS Encryption Keys have been added to all Provider Accounts.

29 Sep
  • Updated available Cassandra version from 2.2.15 to 2.2.18
  • Optimised configuration for Redis

28 Sep
  • Added new metrics to replace old metrics that are now deprecated.

    New metrics:
    n::nativetransportrequest::total_blocked_tasks_per_second_max
    n::droppedmessage::total_count_per_second_max
    n::hintsTotal::value_per_second_max
    n::hintsSucceeded::count_per_second_max
    n::hintsFailed::count_per_second_max
    n::hintsTimedOut::count_per_second_max

    Deprecated metrics:
    n::nativetransportrequest::total_blocked_tasks_differential
    n::droppedmessage::differential_total_count
    n::hintsTotal::differential_value
    n::hintsSucceeded::differential_count
    n::hintsFailed::differential_count
    n::hintsTimedOut::differential_count

    Those metrics on the dashboard has been updated to display the new metrics as well.


23 Sep
  • Fixed bug on Connection Info page when Schema registry add-on is included in the cluster.

18 Sep
  • Azure Availability improvements for Elasticsearch clusters.

17 Sep
  • Resolved MFA issues on SSO enabled accounts – Owner users can enable MFA through their user settings page, and non-Owner users will no longer be redirected to a 404 page for MFA registration.
  • Allowed creation of Kafka Cluster with dedicated zookeeper nodes.

16 Sep
  • Added a validation to prevent creating a VPC peering request with an overlapping subnet with the Cluster Data Centre.
  • Added a validation in provisioning API to check the VPC Peering Connection UUID.

15 Sep
  • Add provisioning support in Switzerland North (Zurich) region for Azure.
  • Provisioning with Debian 9.13 for new nodes.
  • Existing kafka connect trusted cluster feature has been extended to client encryption disabled clusters and renamed to connected clusters.
  • Replacing the Cassandra R4 node size with the R5 node size in SA_EAST_1 AWS region.

14 Sep
  • Released managed mirroring of Kafka clusters using Kafka Connect and Mirror Maker 2
  • Optimised kernel settings for Redis.

11 Sep
  • Minor change to API to improve testability.
  • Released managed mirroring of Kafka clusters using Kafka Connect and Mirror Maker 2

9 Sep
  • Improved performance when changing custom ending time for metrics.
  • Fixed the ‘Need more info’ link on the account security page.

7 Sep
  • Removed r4 Node sizes from cluster creation for Redis.

3 Sep
  • Fixed an issue with certificate renewal for Kafka Schema Registry and Spark Jobserver
  • Added Redis provisioning capabilities to the Terraform Provider.

1 Sep
  • Updated the Elasticsearch e::docsCount monitoring API metric to exclude documents from indices used to calculate SLA metrics.

August 2020

28 Aug
  • Fixed an issue with provisioning large clusters on AWS

27 Aug
  • Making the azure node size D15_v2 available in SOUTH_CENTRAL_US
  • Added an endpoint that returns the details of the authenticated API user at https://api.instaclustr.com/usermanagement/me
  • Fixed a console bug when a user tries to log in without any linked accounts.

26 Aug
  • Added additional metrics for garbage collection and memory usage.
  • Redis: Added ACL support
  • Redis: Added the ability to create a cluster without authentication

25 Aug
  • Implemented additional monitoring to alert on potentially unhealthy Cassandra clusters

24 Aug
  • Released support for setting up Mirror Maker 2 connectors via the console.
  • Released Kafka 2.5.1 and Kafka Connect 2.5.1, new metrics related to the new versions are being rolled out progressively.
  • Fixed an issue on the following pages not showing the node IP addresses for private clusters – Cluster Summary, Metrics Lists, Metrics Graphs

18 Aug
  • Add support for Redis backups on AWS.
  • Redis node sizes added to the pricing page.
  • Add support document links on Redis metrics page on dashboard.

17 Aug
  • Redesigned the header used in the Sign Up page.
  • Expanding AWS region support for Canada-Central, Paris, Stockholm, Hong Kong, and Seoul

14 Aug
  • Fixed an issue when displaying Cassandra table metrics in the Dashboard.

12 Aug
  • Added Client Encryption capabilities for Redis clusters to the Provisioning API.

11 Aug
  • Cassandra 4.0 beta1 has been released for preview.
  • Resolved VPC peering connectivity issue

10 Aug
  • Updated Redis Cluster creation to ensure Master and Replica nodes are split across racks as efficiently as possible.
  • Added support for GCP europe-west6(Zurich) region.
  • Reinstated the display of metrics for replaced nodes in the Dashboard.

6 Aug
  • Automated deployment of scanning agents on PCI clusters.

4 Aug
  • Update node replace to notify staff if backup has failed.

July 2020

30 July
  • Enabled provisioning PCI compliant clusters with public IP.
  • Added a new status property “cdcStatus” for cluster data centres to the cluster status API request.
  • Released Azure VM types L8s and D15v2 with local storage

28 July
  • Added support for optional Redis client encryption

27 July
  • Released support for general shipping of application logs to Kafka clusters

23 July
  • Instance store node types added to Elasticsearch in AWS.
  • n::nodeStatus marked as deprecated

22 July
  • Custom node type for specific customer.

21 July
  • Included pre-built ElasticSearch connector in our Kafka Connect image.

20 July
  • Added encryption for Azure temporary storage on L8s and D15_v2 nodes (Azure default encryption doesn’t cover temporary storage), these sizes are available only upon request.

  • Released functionality to configure a truststore within a Kafka Connect cluster to trust other instaclustr managed clusters.

  • Two Factor Delete is now configurable with the cluster provisioning API endpoint and the introduction of a new cluster update API endpoint that supports Two Factor Delete.
  • Fixed missing connector dependency in Apache Zeppelin image
  • Simplified the dashboard view for customers with large number of clusters

16 July
  • Opendistro-for-Elasticsearch 1.8.0 and Kibana 1.8.0 are now available
  • Turn on failure listener feature for open distro for elasticsearch with security plugin
  • Elasticsearch automated backup frequency changed from once every 24 hours to once every 1 hour


14 July
  • Added additional http security headers to the instaclustr console

13 July
  • Fixed an issue causing errors when using the Provisioning API to add encryption keys for some AWS regions.

09 July
  • Released Kibana for Open-Distro Elasticsearch.
  • Fixed an issue that caused misleading errors when attempting to delete non-existent encryption keys via the Provisioning API and Dashboard.
  • Updated the Dashboard so that metrics for replaced nodes are now displayed.

08 July
  • Changed IDS logs to group by customer clusters.
  • Updates to node security.
  • Updating aliases on nodes for ease of use on PCI clusters
  • Added extra logging to metrics collector on nodes
  • Fixed an issue where the following non-PCI verified add-ons could be included when provisioning a PCI compliant cluster : Kafka Rest Proxy, Kafka Schema Registry, Cassandra Lucene Index Plugin
  • Create Firewall Rules API Endpoint is updated with creating firewall rules mapped by AWS security group ID. With the new changes, the user can create, delete, and list firewall rules for AWS security group ID as well.

07 July
  • Elasticsearch restore enabled from Provisioning API for customers.
  • Elasticsearch restore enabled from the Dashboard for customers.
  • Updating aliases on nodes for ease of use on PCI clusters
  • Added extra logging to metrics collector on nodes

02 July
  • Introduce new metrics for kafka topic message distribution including, outliers with respect to number of messages in partitions within a topic using the MADe method and the standard deviation for the partition message counts as a measure of dispersion. These metrics will be enabled gradually across clusters

01 July
  • Implemented latency and memory metric collection for Redis cluster

02 July
  • Fixed memory available unit in monitoring metrics
  • Added Kafka Connect plugins for the communication between Kafka and Cassandra.

June 2020

26 June
  • Added Azure L8s and D15_v2 node sizes using temporary storage for a customer.

25 June
  • Bug fix causing node replace to fail for clusters that use private broadcast.
  • Fixed a bug in the provisioning api firewall rules endpoint.

23 June
  • Fixed the issue that provisioning API falsely reports CDC configurations of Kafka clusters.
  • Removed broker_encryption from the example of provisioning API support doc.

22 June
  • Added additional infrastructure monitoring metrics.
  • Improved reliability of IDS system.
  • Introduction of a new user management API to change user roles.

18 June
  • Fixed an issue with the encryption-keys endpoint that was causing timeouts and variability in response times.

17 June
  • Released Kafka broker level Fetcher Lag metrics via the API and Dashboard. This metric will be enabled progressively on clusters.
  • Released the functionality for adding nodes to KafkaConnect clusters, through the console.

16 June
  • Elasticsearch on GCP and Azure has been released.
  • Elasticsearch backup enabled from the dashboard for customers.
  • Elasticsearch backup supported using provisioning API.
  • Stop collecting task level error metrics for deleted connectors and tasks.
  • Fixed an issue in AWS Kafka-Connect nodes reporting incorrect values for Leader State metric

12 June
  • Added Custom Heroku plans for customer.

11 June
  • Updates to the sign-on page that will see a shift to a 2-stage login and preparations for customer facing security enhancements to be rolled out in the coming months.

09 June
  • Adding differential graphs

04 June
  • Kafka Connect general availability released
  • Support for Kafka Connect 2.4.1 released
  • Fixed an issue with the provisioning API’s describe-options endpoint.
  • Bug fix: Do not trigger monitoring alerts for cluster state when Redis cluster is still being provisioned
  • Updated Redis Preview to 6.0.4
  • Introduced c5 instance types (c5.xlarge, c5.2xlarge, c5.4xlarge) for Kafka offerings

03 June
  • Extended Same Vpc Restores to determine next available vpc cidr block.

02 June
  • Removed support for creating Cassandra cluster with Zeppelin through the console
  • Updated Redis node size pricing for GCP and Azure
  • Restored Full Chain Certificates

May 2020

29 May
  • Changes to instaclustr kafka connect aws storage connector plugins including fixes to config error reporting, bug fixes to source connector, and capability to specify AWS region for s3 clients.

28 May
  • Resolved an issue when creating a Redis cluster on the console
  • Added more Kafka metrics (RequestsPerSec and ControlPlaneNetworkProcessorAvgIdlePercent), and the number of sockets on CLOSE-WAIT status.

27 May
  • Added Kafka connect availability metrics.
  • Improve add nodes page for Redis cluster, to let users configure master and replica nodes separately.
  • Improved help context for connecting to Elasticsearch clusters.

25 May
  • Fixed issue with provisioning redis clusters
  • Added links to support documentation for client connection metrics.
  • Added rest proxy and schema registry DNS to connect to node via private IPs.
  • Enabled node provisioning with Debian OS by default.
  • Removed the deprecated option ‘backupEnabled’ from Provisioning API. Please see Provisioning API support doc for further details.

22 May
  • Added more node types for running Kafka Connect in the AWS and Azure.
  • Improved memory allocation for Kafka Connect nodes during cluster creation.
  • Fixed an issue with the provisioning API’s describe-options endpoint.

21 May
  • Replaced Heroku t2 plans with t3 plans

18 May
  • Released Apache Cassandra 3.11.6.1
  • Added RequestDiscarded and PausedConnections metrics to Cassandra 3.11.6.1

14 May
  • Redis Public Preview is available to provision

13 May
  • Added Kafka Connect Task Level metric collection and exposing via instaclustr monitoring API. This feature will be gradually enabled in clusters. Refer https://www.instaclustr.com/support/api-integrations/api-reference/monitoring-api/kafka-connect-metrics/ for metric definitions

12 May
  • Added feature to allow Kafka Connect logs to be shipped to a connected Instaclustr Kafka Cluster.
  • Updated pricing information for Elasticsearch.

6 May
  • Released updates to node security.

5 May
  • Changed Native Transport Request’s Total Blocked graph to Differential Blocked Tasks.

4 May
  • Added support for running Kafka on r5 nodes in the AWS SA_EAST_1.
  • Disabled support for running Kafka on r4 nodes in the AWS SA_EAST_1.

April 2020

30 April
  • c5d.2xl has been added to AP_SOUTH_1 region.

29 April
  • Released Kafka 2.4.1.

24 April
  • Updated validation error messages for Kafka Connect cluster creation request
  • Kafka Connect Azure preview support released.

23 April
  • Released updates to node security

14 April
  • Support new functionality on console and provisioning API to provision the Kafka Connect cluster into the same AWS VPC as the target Kafka cluster.
  • Add restrictions on cluster deletion feature to not allow deletion of a Kafka cluster, if it has a dependent Kafka Connect cluster.
  • Additional validation checks implemented for Kafka Connect cluster create request.
  • Fixed a bug where the default node size was not set correctly on the create cluster and add datacentre pages.

06 April
  • Added more frequent sampling of dynamic metrics to our internal monitoring system.

March 2020

27 March
  • Elasticsearch GA released which contains several features and upgrades, such as:
    • Support for Opendistro for Elasticsearch v1.4.0.
    • Support for Dedicated Master nodes.-
    • SLA metrics and related alerts.
    • Cluster provisioning and metrics collection through API.
    • Support for Opendistro for Elasticsearch Security Plugin.

26 March
  • Instaclustr s3 storage connector v0.1.0 released as an inbuilt kafka connect connector plugin
  • Creation of PCI enabled clusters enforces Password Authentication, User Authorization and Client-Node encryption

19 March
  • Kafka Connect connector plugins that are available for your cluster is now visible from the console.
  • Added ability to view Leader state for Kafka Connect clusters on the Dashboard for periods longer than 1 hour.

11 March
  • Made VPC Peering mandatory for Kafka Connect clusters pointing to a Kafka cluster with Private IP’s only add-on.
  • Made VPC Peering the default option for Kafka Connect clusters when possible.

05 March
  • TCP socket and file descriptor information metrics added to the monitoring API.
  • Kafka detailed request and response processing time metrics and flush latency metrics added to the monitoring API.

04 March
  • Give feedback to user when creating a Kafka Connect cluster with invalid Custom Connector properties.

  • Provide warning of financial/latency impact when creating Kafka Connect cluster pointing to Kafka cluster in different region/provider.

  • Added HTTP API call to sync Kafka Connect Cluster plugins.


03 March
  • Standardized database role permissions

February 2020

25 February
  • Cassandra 4.0 Alpha3 has been released for preview.

19 February
  • Updates to node security
  • Release the ability to create PCI compliant clusters via the API and Console

18 February
  • New Feature : Kafka Connect Managed Service (Preview Release) – Support Documentation
    • Support on AWS (Support for other providers coming soon).
    • Run in our cloud provider account with a fixed, infrastructure inclusive, cost or use your own cloud provider account
    • Provision, configure and monitor your cluster using the Instaclustr Console and API.
    • BYO Connectors, customers can bring in their own connectors
    • Highly responsive, enterprise-grade, 24×7 support from Instaclustr’s renowned support team.

16 February
  • Released Cassandra versions 3.0.19 and 2.2.15

14 February
  • Improvements to cluster alerting

12 February
  • Made Kafka Topics sorted in Metrics page in Dashboard
  • Updated signup form to not autofill invalid characters into the username field
  • Fixed race condition that caused signup emails to not always be sent.

New Feature: Elasticsearch Managed Service (Preview Release)

Instaclustr’s Managed Elasticsearch provides the following management features:

  • Support on AWS (Support for other providers coming soon).
  • Run in our cloud provider account with a fixed, infrastructure inclusive, cost or use your own cloud provider account
  • Provision, configure and monitor your cluster using the Instaclustr Console.
  • Management of access via IP ranges or security groups.
  • Option of connection to your cluster using public IPs or private IPs and VPC peering.
  • Private network clusters with no public IPs.
  • SOC2 certification will be introduced in Generally Available (GA) release
  • Highly responsive, enterprise-grade, 24×7 support from Instaclustr’s renowned support team.

10 February
  • Disable deprecated t2, m4, and r4 node sizes
  • Add M5 node size to Sydney
  • Support R5 node size in Sydney
  • Remove Cassandra 2.1 for new clusters

5 February
  • Fixed a bug that caused the 2-factor delete flag not to be displayed immediately after changing its value on the cluster settings page.
  • Fixed a console bug that Cassandra client encryption selection is not honoured when creating clusters.

3 February
  • Fixed a bug that Spark and/or Zeppelin can’t be enabled when adding a new datacentre to an existing cluster.
  • Added new metrics to the api and dashboard. The new metrics added include Network, Memory, Additional CPU and Kafka Garbage collection metrics.

January 2020

29 January
  • Added additional logging for our spark offering

28 January
  • Updated formatting of slaTier return result from the cluster info request. “Non-Production” -> “NON_PRODUCTION”

20 January
  • Added new repair operations for our Cassandra Clusters

13 January
  • Fixed issue that cause password expiry password reset to fail when there was a case mismatch.

December 2019

16 December
  • Fixed state filtering on Cluster Health page
  • Monitoring API bug fixes.
  • Fix JS error that occurred when selecting Elasticsearch on the create cluster page.

12 December
  • Fixed data centre network info not showing on the console
  • Increased system node security
  • Fixed issue with Zookeeper allocation in Azure regions with 2 fault domains
  • Creation options for Kafka clusters made visible in the console

6 December
  • Released the updates to node security

5 December
  • Added disk usage per topic metric for Kafka clusters

3 December
  • Minor updates to internal log aggregation policies

November 2019

27 November
  • Added ability to create Kafka users with reduced initial permission sets
  • Fixed error in cluster 2FA deletion request

25 November
  • Database migration and improvements to infrastructure

22 November
  • Fix icons not loading on Dashboard pages

21 November
  • Released support for Kafka 2.3.1

07 November
  • Increased free trial period to 30 days.

06 November
  • Updated account security restrictions to apply to users when they are accessing any page including other accounts

October 2019

31 October
  • Updated code examples on the dashboard for connecting to Cassandra

28 October
  • Improvements to internal Monitoring System
  • Improvements to Gateway Operations

23 October
  • Cassandra hinted handoff metrics released to API and Instaclustr console

23 October
  • Updated UI to reflect multiple free trial clusters
  • Added some additional security mechanisms to our managed service
  • Added some additional support logging for our managed service

21 October
  • Bug fix to the output of node status values in monitoring API.
  • Applied CIS recommendation for network configuration.
  • Added banner with a warning message to be displayed when a node is logged into.

17 October
  • Fix signup button not working when redirect from invitation email.
  • Users who sign up with non-work related emails with coupons can provision free-trial clusters.
  • Updated coupons to be able to add extra free trial clusters.
  • Fix signup button not working when redirect from invitation email.
  • Improved cookie security for Heroku SSO logins.

14 October
  • Fix the prematurely session timing out when not all the accounts linked to user have session timing out option enabled.
  • Added additional security mechanisms to our Apache Cassandra managed service.

10 October
  • Make available hostname validation for secure connection to Cassandra cluster
  • Enforce TLSv1.2 or above on dashboard and API endpoints.

8 October
  • Implementing hardening procedures for customer nodes
  • PCI compliant SSH connection configured in nodes
  • Updated expiry of old users from accounts to apply on a schedule and not on login
  • Added maximum length validation on String based input fields

3 October
  • Standardised user setup on management instances

1 October
  • Fixed invited users unable to signup bug

September 2019

30 September
  • Fixed issue with production of snappy and zstd Kafka messages

23 September
  • Fixed handling of configs when creating topics with the ic-kafka-topics.sh tool

19 September
  • Released support for Kafka 2.3.0

17 September
  • Released kafka consumer lag monitoring feature. The metrics are reachable through the instaclustr dashboard and the monitoring API

16 September
  • Updated CoreOS version on nodes to 2191.4.1

13 September
  • Fixed bug related to Javascript loading

10 September
  • Removed unused filesystem and protocol support (PCI compliance)

9 September
  • Improve signup page UI/UX

5 September
  • New Kafka and Zookeeper instances moved to JRE 11

3 September
  • Added a Download Full Log to the spark worker log page that downloads the complete log file.

2 September
  • Introduced new hardening procedures on customer nodes

August 2019

28 August
  • Some enhancements on the Prometheus API support

19 August
  • Added support for new AWS instance type – R5 for Kafka
  • Added support for new AWS instance type – i3en.xlarge in selected regions

12 August
  • AWS T3 instances made available for both Cassandra and Kafka in all supported regions.
  • Released a patch for a bug in Cassandra which can cause nodes to join or replace without data

07 August
  • Added hyperlinks to Terms of Service and Privacy Policy on the signup page
  • Added Prometheus support to Monitoring API
  • Added compatibility for Spark 2.1.3 including Spark Jobserver to Cassandra 3.11.4

06 August
  • Fixed ic-kafka-topics tool to prevent it from printing out properties when used

05 August
  • Updated disclaimer texts and removed Elasticsearch EAP text
  • Updated Kubernetes Service Broker to return cluster authentication credentials for Service Binding

01 August
  • Introducing new AWS availability zones to London, Tokyo and Singapore

July 2019

31 July
  • Updated CoreOS version on nodes.

24 July
  • Node size m5 is now available in all the regions except Sydney. Node size m4 instead of m5 is available in Sydney region.

23 July
  • Added new features to the cluster restore operation

22 July
  • Making cassandra secondary indexes get backed up and restored

18 July
  • Deprecated creation of Kafka clusters below version 2.1.1
  • Enhanced console error handling for metrics graph display.

17 July
  • Updated token allocation for new clusters with Lucene enabled

15 July
  • Updates to the node security

12 July
  • Bug fix for enabling Lucene on new DCs.

08 July
  • Added support for new AWS instance type – r5.

03 July
  • Bug fix for adding data centres to existing private network clusters.

02 July
  • Improve display of read and write latency graphs in console
  • Pricing update

01 July
  • Hide add-ons not supported for Kafka during provisioning.

June 2019

27 June
  • Fixed console bug to correctly display Broadcast Private Address for Private Network Clusters.
  • Exposed 99th Percentile metric for Cassandra Client Read and Write to Console
  • Added support for customers to provision a cluster or data centre into a custom Vpc in AWS

26 June
  • Updated Internal Metrics Collection

17 June
  • Bug fix for handling of node allocation in two-rack Azure regions.

13 June
  • Allowing altering of Apache Kafka ACLs.

12 June
  • Adding the storage volume type for each SSD.

11 June
  • Added support for new AWS instance type – m5

05 June
  • Fixed the bug that displayed ‘free-trial expired’ warning for accounts with valid billing details.

May 2019

29 May
  • Added AWS c5d.2xlarge node size to Tokyo region
  • Moved ‘Instaclustr’ account to the bottom of Provider Accounts dropdown list in console for RIYOA customers

23 May
  • Released support for Kafka 2.1.1

21 May
  • Fixed default behaviour of UnderMinIsr alerts. Support of raising UnderMinIsr alerts by adding configuration at Topic level
  • Kafka client tool updated to version 2.1
  • Added kubernetes service broker support – see our support page

20 May
  • Added validation for maximum number of nodes per rack to the console

13 May
  • Release Zookeeper 3.4.14 for kafka

9 May
  • Add option to ignore backups from specific node backups when performing a restore

8 May
  • Updates to node security

2 May
  • Introduced throttling of newly replaced Kafka brokers to improve performance of running clusters

April 2019

30 April
  • Removed Kafka ISR Shrink/Expand Mean rate from Monitoring.

23 April
  • Released Instaclustr-Support role functionality for better customer support and security.

17 April
  • Fixed niche case of backup fails hanging indefinitely
  • Fixed GCP backups failing in certain cases due to table size

16 April
  • Fixed bug causing user to be unable to select node sizes when adding a new data centre to an existing cluster.

15 April
  • Updated control system to not start node if a restore has failed.

11 April
  • Added i3.xl and i3.2xl instance offerings for Kakfa.
  • Converted AWS Kafka offerings to GP2 EBS.
  • Upgraded the base operating system.
_____________________________________________________________________
1 April
  • Updated example Kafka connection settings provided on the console.
  • Corrected out of date ‘Suggested fix’ information on the console cluster health metrics page
  • Add option to create cluster with either production or non-production tag through console and API.

March 2019

29 March
  • Fixed bug that caused custom tagging to not be applied to AWS instances.
_____________________________________________________________________
28 March
  • Added Cassandra 3.11.4, 3.0.18, 2.2.14, and 2.1.21
_____________________________________________________________________
25 March
  • Updated Price and Features tab with relevant messages
_____________________________________________________________________
19 March
  • Fixed problem creating m4l-250 sized clusters with the provisioning API.
_____________________________________________________________________
4 March
  • Increased robustness of Kafka node reboots.
_____________________________________________________________________

February 2019

28 February
  • Implemented on-creation tagging for AWS EC2 Instances and EBS Volumes.
  • Updated disk size of selected AWS instances.
_____________________________________________________________________
27 February
  • Fixed the private IP cluster gateway’s SSH failure.
_____________________________________________________________________
25 February
  • Release Spark 2.3.2 and Zeppelin 0.8.0 with Spark 2.3.2
_____________________________________________________________________
21 February
  • Bug fix for adding multiple datacentres to some cluster bundles.
  • Bug fixes for some links in Spark UI.
  • Made the Kafka Rest Proxy offering available for our customers.
  • Releasing the whitelist updates.
  • Tuning of Kafka alert thresholds.
_____________________________________________________________________
18 February
  • Added support for Azure US West 2 (Washington) region.
_____________________________________________________________________
11 February
  • Fixed internal bug causing transitions from DSE to Cassandra to fail.
  • Updated text on the console’s signup page.
_____________________________________________________________________
7 February
  • Fixed rendering issue for emails notifying a customer a cluster resize was finished.
  • Cluster deletion verification email sent to contact from 2FA cluster settings.
_____________________________________________________________________
5 February
  • Fixed bug in restoring from clusters with large numbers of commit logs
  • Added auto-cleanup for dangling snapshots from interrupted backups
_____________________________________________________________________

January 2019

31 January
  • Fix to internal management tooling
_____________________________________________________________________
23 January
  • Introduced a toggle switch for monitoring pages to switch the displaying node IP addresses between private and public addresses.
_____________________________________________________________________
21  January
  • Updates to Node Security
  • Standardised out-of-memory error handling
  • Improved configurability of Kafka images with new versions: apache-kafka:1.1.0.ic2, apache-kafka:2.0.0.ic1, apache-kafka:2.0.1.ic1, and apache-kafka:2.1.0.ic1

14  January
  • Fixed a rare provisioning issue
  • Fixed a rare restore from backup issue

9  January
  • Added support for on-premises clusters

2 January
  • Resolved not being able to resize a datacenter with keyspace replication factors larger than the rack count using the dashboard

December 2018

17 December
  • Bug fix for accepting an account invite, if the user does not already exist

12 December
  • Updates to node security

4 December
  • Fixed the issue that valid security group ID’s are not passing Console’s input validation

November 2018

28 November
  • Improved support for clusters with large numbers of firewall rules in AWS

26 November
  • Added support for provisioning Kafka 2.1.0 and 2.0.1 clusters
  • Added missing Kafka node sizes in Azure US East 2 region
  • Added refresh button to graphs on Monitoring/Metrics Graphs page
  • Improved scaling and alignment of metric graphs

22 November
  • Fixed certificate download URL returned by API request
  • Fixed Spark UI display issue

19 November
  • Added support for provisioning Kafka 2.0 clusters

13 November
  • Fixed Spark master assignment issue when adding nodes to a cluster

6 November
  • Set new Cassandra 3 clusters to use 16 vNodes by default
  • Updates to monitoring
  • Updates to node security

October 2018

29 October
  • Allowed custom config to be applied to clusters with nodes that are not yet running
  • Update Jackson Databind library version to resolve vulnerability issue

23 October
  • Increase resilience and capacity of internal messaging service

16 October
  • Update names of read/write metrics in console to be clearer
  • Released Cassandra 3.11.3 , 3.0.17 and 2.2.13

12 October
  • Updated available versions of Spark and Spark Jobserver to 2.1.3 and 0.8.0

11 October
  • Improve instructions regarding new password restrictions

8 October
  • Added support for 11 new regions in Google Cloud Platform
  • Restricted Spark and Zeppelin add-ons from being used on developer size nodes in GCP
  • Fixed issues with provisioning large Kakfa clusters in GCP
  • Fixed an issue with bundle selection on the Console

2 October
  • Improved backup stability on clusters with large number of sstables
  • Updates to node security
  • Removed support for creating Elassandra clusters from console and API

September 2018


25 September
  • Fixed an issue where VPC peering connections are not created correctly when trying to create multiple peering connections on the console
  • Implemented better handling of ad-hoc AWS provisioning failures

20 September
  • Updated Instaclustr logos on the Console

17 September
  • Improvements to Node Security

10 September
  • Fixed issue with Zeppelin Spark interpreter not displaying exceptions

5 September
  • Changed the category for c5d nodes from ‘Production Special’ to ‘Production’

4 September
  • Fix problem with restoring replaced nodes to a point in time before they were replaced
  • Fix issues with replacing some Kafka nodes
  • Fix issue with replacing Zeppelin or Spark Jobserver nodes

August 2018


30 August
  • Updates to node security
  • Fixed ‘Page Not Found’ issue on Console
  • Fixed monitoring page on Console

29 August
  • Improvements to internal logging

27 August
  • Introduced AWS c5d.2xlarge node size with NVME storage
  • Retired AWS c3.2xlarge node size

23 August
  • Removed security vulnerability in Dashboard to Zendesk SSO
  • Fixed provisioning issue

22 August
  • Improved provisioning error handling

21 August
  • Console is compliant with GDPR

15 August
  • Fixed a bug in the provisioning API that caused duplicate clusters to be listed in some situations

14 August
  • Fixed issues with validations in VPC Peering requests
  • Fixed node sizes on ‘create cluster’ page not updating properly after changing the data centre location
  • Fixed cluster disk health message to accurately show percentage of disk used
  • Fixed create cluster page to correctly display the spark and zeppelin versions available for provisioning

13 August
  • Improve automatic handling of system_auth keyspace replication

9 August
  • Improvements to security auditing capabilities and internal operations visibility
  • Improved internal monitoring tooling.

8 August
  • Improvements to internal Cassandra testing
  • Users are able to receive T&C updates on console
  • Minor console UI improvements on signup and cluster creation page

7 August
  • Reliability improvements to logging infrastructure

1 August
  • Updates to node security

July 2018


31 July
  • Bug fix in Kafka metrics alerting threshold
  • Fix to node management internal tooling

30 July
  • Scaled internal monitoring systems
  • Added additional metrics for cluster management & monitoring

25 July
  • Fixed the inconsistent ordering in pricing page.
  • Added extra validation to username, company name and phone number fields on account creation page.
  • Disabled the ability to provision Elassandra on t2.small node size.
  • Disabled Elassandra 2.4.2.13 for console and API.
  • Enabled various Cassandra ThreadPool metrics for Console and Monitoring API, including Read stage, Native Transport Requests, Mutation Stage, Counter Mutation Stage, View Mutation Stage, RPC Thread and Total Dropped Messages.
  • Fixed 500 error on Spark worker page.

17 July
  • Fixed Console impersonation bug
  • Fixed provisioning issue with some older Cassandra versions

16 July
  • Added User management UI for Kafka clusters
  • Fixed node size display ordering issue
  • Removed deprecated node sizes from Console
  • Removed ability to enable client encryption for developer sizes
  • Clicking on graphs in Cluster Summary page now takes users to Metrics Graph page instead of 404
  • Updated Console to display correct memory amount for GCP n1-highmem-2 nodes

10 July
  • Add support for Cross Region VPC peering through Dashboard and API
  • Improved VPC peering reliability
  • Updated IBM Softlayer to its rebranded name: IBM Cloud
  • Updated provider logos for AWS and GCP

04 July
  • Improved restore process for deleted clusters

03 July
  • Updates to node security

02 July
  • Update Kafka connection information on the Console
  • Fixed issue when the user chooses not to create a firewall rule when creating a Cassandra cluster but a firewall rule is still created
  • Disabled adding nodes to cluster for users with no billing details
  • Fixed issue where customers are unable to select EBS encryption keys on the console for non EBS-backed node sizes
  • Fixed issue where a wrong network is suggested when trying to add cluster data centre to an existing cluster
  • Updated instance system kernel settings for better performace
  • Fixed issue of accumulated MigrationStages when cluster is under load
  • Improved bootstrap logic for node-agent
  • Add timestamp to bash history for internal TechOps

June 2018


28 June

26 June
  • Apache Cassandra 3.11.2.2 is now available

  • Updates to Kafka release including:
    • Synthetic Transaction monitoring
    • Per-Topic metrics
    • Exposing additional configuration options
    • Zookeeper backups
    • SSL broker-to-broker encryption is now required on all clusters

21 June
  • Optimized metric calculation


20 June
  • Updates to node security


19 June
  • Increased reliability of provisioning large (50 nodes or more) clusters
    Fixed issue affecting cluster deletion for instances provisioned on GCP


13 June
  • Minor improvement to internal management tooling

  • Bug Fix: Ignore aborted requests from user interaction

  • Fixed console display of incorrect pricing

12 June
  • Update internal security functionality
  • Improved formatting of internal audit messages

May 2018


31 May
  • Fixed password change emails not being sent sometimes
  • Added emergency contact field in Account Details on console. Customers can now optionally specify seperate email addresses for emergency contact

29 May

Additional new Instaclustr security features that can be optionally enabled:

  • User Expiration – Unused User Accounts will be expired after inactivity for 90 days.
  • Password Expiration – Passwords expire after 90 days.
  • Account Enforced MFA – Accounts with the feature enabled require MFA.
  • Session Management – User sessions timeout after 15 minutes of inactivity and have a total session time of 30 minutes.

24 May
  • Remove support for provisioning new Scylla clusters
  • Ended beta status for the Private Network Clusters add-on
  • Update account creation page for GDPR compliance
  • Fix minor console bugs with VPC peering

21 May

New Feature: Kafka Managed Service (Preview Release)

Instaclustr’s Managed Apache Kafka provides the following management features:

  • Support on AWS, Azure, GCP and IBM cloud
  • Automated provisioning and configuration of clusters with Kafka and Zookeeper
  • Run in our cloud provider account with a fixed, infrastructure inclusive, cost or use your own cloud provider account
  • Provision, configure and monitor your cluster using the Instaclustr Console or REST APIs.
  • Management of access via IP ranges or security groups.
  • Option of connection to your cluster using public IPs or private IPs and VPC peering.
  • Private network clusters with no public IPs.
  • SOC2 certification will be introduced in Generally Available (GA) release
  • Highly responsive, enterprise-grade, 24×7 support from Instaclustr’s renowned support team.

15 May
  • Fixed issue relating to adding data centers to some clusters

08 May
  • Support for Cassandra 3.11.2 and 3.0.16

April 2018


24 April
  • Fixed ordering of node sizes on dashboard

23 April
  • Minor bug fix to configuration deployment


17 April
  • Major upgrade to internal tooling

10 April
  • Updates to node security

  • Restore API now returns the ID of the new cluster

5 April
  • Fix for minor bugs affecting some password resets and user invitations

  • Fix Pagerduty alert issue
  • Improvements to internal Monitoring Application and Alerting


3 April
  • Added new node administration feature for use by Operations team
  • Fixed issue affecting future certificate renewals

March 2018


29 March

27 March
  • Fix to Azure rack allocation calculation

26 March
  • Updates to Internal Monitoring System

22 March
  • Adding support for Elassandra 5.5.0.13 (Cassandra 3.11.2 + Elasticsearch 5.5). Compatible with Spark 2.1.1
  • Updated Kibana monitoring timeout for new version

21 March
  • Fixed provisioning bug affecting provisioning new clusters in Google Cloud Platform

20 March
  • Improvements to cluster health check

15 March
  • Minor bug fix to provisioning and monitoring

  • Fix to internal monitoring system

13 March
  • Updated Azure pricing


8 March
  • Provide more informative error messages when failing to provision custom firewall rules

5 March
  • Minor internal alerting fix
  • Fixed backups list pagination on “Restore Cluster” page
  • Updated introduction text on the “Sign Up” page

1 March
  • Improved data centre joining and migration processes

February 2018


28 February
  • Infrastructure maintenance

22 February
  • Upgraded system to use Latest Pagerduty API

 20 February
  • Fixed a node replacement issue with older nodes

  • Improved two-step cluster deletion procedure


15 February
  • Upgrade to internal fleet monitoring tools
  • Resolved issues preventing provisioning of AWS i3.2xlarge in US_EAST2, EU_WEST_2 & AP_SOUTH_1

 12 February
  • Cassandra sidecar has been replaced by a generic sidecar module
  • Fixes to fleet logging

 7 February
  • Add additional monitoring checks to Instaclustr API

1 February

January 2018


30 January
  • Fix issue which would cause Elassandra root volume to fill under certain conditions.

18 January
  • Minor Console UI fixes.

8 January
  • Changes required to support most recent CoreOS version.

December 2017


20 December
  • Updated node security

19 December
  • Removed option to create new clusters based on AWS m3.xlarge

15 December
  • Centralised logging systems improvements to better work with NTP servers.

12 December
  • Adds 99th percentile client latency metrics to the monitoring API

November 2017


28 November
  • System updates to improve internal functionality of the cluster restore feature.
  • Adds support for logical racks

27  November
  • All Azure clusters will now use Premium Managed Disks with Storage Service Encryption for data at rest.

20 November
  • Displays CASRead, CASWrite and RangeSlice metrics on Console
  • Adds API Support for CASRead, CASWrite and RangeSlice metrics.
  • New look and feel for support articles
  • Added a new email template for customer, whose free trial expires in one day and has filled billing details.

15 November
  • Fix to certificate renewal process

 13 November
  • Support for AWS i3.2xlarge
  • Fix error on Instaclustr Console Spark page
  • Fix to cluster deletion process

02 November
  • Minor Console UI changes

01 November
  • Minor stability improvements to Monitoring API

October 2017


30 October
  • Support for Cassandra 3.11.1, 3.0.15, 2.2.11 and 2.1.19

25 October
  • Bug Fix: Monitoring API  metrics return 0.0 instead of NaN

24 October
  • New Feature: Private Network Cluster (Beta)

September 2017


22 September
  • New Feature: AWS SaaS Marketplace based billing

11 September
  • Minor fix to Free Trials
  • Improve node Security

4 September
  • Minor bug fixes to backups

August 2017


31 August
  • Resizeable nodes improvements
    • Updates to default node provisioning limits
    • M4-l Resizeable nodes removed
    • Resizeable nodes added to EU_WEST_2
  • Console Improvements
    • Fixed autocompleting 2FA/TOTP codes on login page.

30 August
  • Updated branding on selected customer communications.

28 August
  • Changes done to enable Broadcast Private IP for Azure -> RIYOA
  • Removed redundant Free Trial information when clusters are provisioned with RIYOA

25 August
  • Fixed bugs of storage permissions in backup process

24 August
  • Added options to choose custom subnet when creating or adding a data centre

22 August
  • Monitoring API updates
    • Changed metrics limits in a single monitoring api call to 20
    • Restored missing metrics incorrectly removed in previous deployment

21 August
  • Console and Monitoring API improvements
    • Fixed a bug preventing display of metrics for materialised views
    • Fixed a bug preventing display of certain latency metrics in Cassandra 3.11

17 August
  • Monitoring improvements
    • Added monitoring for Kibana

15 August
  • Minor improvements to restore process

2 August
  • Cassandra version update
    • Added support for Cassandra 3.0.14

July 2017


31 July
  • Console Improvements
    • Handle lack of certificates on the console
    • Handle bad Zeppelin link
    • Properly handle bundle versions selection

27 July
  • Certificate Management
    • Fix in certificate renewal process

24 July
  • Scylla 1.7.2
    • Added support as a preview release

20 July
  • Certificate Management
    • Fix in certificate revocation process

19 July
  • Metric Collection
    • Added configurable options for SLA metric collections

14 July

13 July
  • Cassandra version update
    • Added support for Cassandra 3.11, Cassandra 2.1.18 and Cassandra 2.2.10

11 July
  • Console Graph Improvements
    • Customers can now multi-select nodes on the Cluster Summary and Metric Graphs pages
    • Tooltip values are sorted, showing you the highest and lowest 5 nodes for a metric at any point in time
    • Nodes in large clusters are consistently coloured until you refresh the page

6 July
  • Spark Update
    • Release spark 2.1.1 with Scala 2.11
    • Updated Spark-jobserver 2.0.0 with Spark 2.1.1
    • Release a new image for Zeppelin 0.7.1 with Scala 2.11 and Spark 2.1.1

4 July
  • Added AWS Availability Zone Support
    • Customers can now provision Clusters across three racks (availability zones) in the Frankfurt (eu-central-1) and São Paulo (sa-east-1) regions.

June 2017


19 June
  • Automated Repair improvements
    • Improved handling of long running repairs
    • Improved handling of potential repair failure cases
    • Fixed an issue causing too many concurrent repairs

15 June
  • Elassandra/Kibana – Beta Release
    • Elassandra and Kibana are now available as options for automatic provisioning through the Instaclustr management console (currently offered as a beta release without SLAs).

May 2017


25 May
  • Cluster Data Centre Resize Support
    • Adds the facility to vertically scale an entire data centre by adjusting the number of CPU cores and Memory quota allocated to each node.

19 May
  • EU (London) Region Support on AWS
    • Customers can now provision clusters using the AWS EU_WEST_2 (London) region either in Instaclustr’s AWS account or their own account.

8 May
  • Console Update
    • Console/dashboard now indicates when Cassandra fails to report some metrics.

4 May
  • Console Update
    • Added spark Cassandra connector support to console
    • Fixed problem with CSS of Spark UI

3 May
  • Console Update
    • Corrected reported CPU instance details for AWS T2.Mediums

1 May
  • Console Update
    • Enforce restrictions on weak passwords

April 2017


24 April
  • Metrics collection
    • Improvements to make metric collection more resilient to Cassandra exceptions

18 April
  • AWS EBS Optimisation
    • Fix bug that caused some AWS instances to be not EBS-Optimized.

11 April
  • Spark Update
    • Release spark 2.0.2 with Scala 2.11
    • updated Spark-jobserver 2.0.0 with Scala 2.11
  • Zeppelin Update
    • Release zeppelin 0.7.1 with scala 2.11
  • Console Improvements
    • Updated Spark-Cassandra connector (Spark 2.0.2 for Scala 2.11)

7 April
  • GCP Offering
    • Google Cloud Platform (GCP) no longer in beta

6 April
  • Console Update
    • Corrected role description for cluster_admin role

March 2017


30 March
  • Support new Cassandra version
    • Added support for the new Instaclustr Cassandra LTS release 3.7 (v3)

14 March
  • Enable free trial on GCP
    • n1-standard-1 is now available for a 14 day free trial with Google Cloud Platform.

February 2017


21 February
  • Support new Cassandra versions
    • Added support for Cassandra 3.0.10 and Cassandra 3.10.

15 February
  • Support new instance type on AWS: R4 XLarge
    • Added support for R4 XLarge node size
    • Added 2 configurations: himem bulk (R4 with 2000G disk space) and himem balanced (R4 with 1200G disk space)

9 February
  • Zeppelin Update
    • released version 0.6.2 of Zeppelin
  • Azure Improvement
    • reduced memory footprint of backup process

2 February
  • Console Improvements
    • Fixed DAG Visualization display on Spark console

January 2017


11 January
  • Console Improvements
    • Fixed 30-day graph navigation
    • Cassandra Lucene plugin pricing change
    • Improved custom AWS tag application

9 January
  • New region support for AWS and Azure
    • US East (Ohio) and Asia Pacific (Mumbai) for AWS
    • Australia East (NSW) and Australia South East (Victoria) for Azure

4 January
  • Console Improvements
    • Added CSRF token check to logout path
  • Monitoring API
    • Added unit field to each metric

December 2016


28 December
  • Console Improvements
    • Added reCaptcha challenge on password reset requests

22 December
  • Cassandra Lucene Index
    • Added support for Cassandra Lucene Index Plugin as a preview release.
  • Azure Improvements
    • Fixed some issues related to provision in existing resource groups.
  • AWS RIYOA Tagging
    • Add ability to add custom tags for RIYOA instances

15 December
  • Console Improvements
    • Fixed Spark UI issues when using Jobserver

13 December
  • Azure Improvements and Monitoring API enhancements
    • Enabled provisioning in existing Azure resource groups
    • Removed Azure classic provisioner
    • Added Cassandra data centre name of each nodes into the returning monitoring information.

November 2016


30 November
  • Support for Google Cloud Platform (GCP) – Beta
    • Added support for GCP. Customers are now able to provision Cassandra & Spark clusters on GCP either in Instaclustr’s or their own account. For more details, please see this blog post.

22 November
  • Run in your own account security improvements
    • Changes to standard run in your own account cross-account trust configurations for improved security

21 November
  • Cassandra version update
    • Apache Cassandra ver. 3.7 (patched v2) and Datastax Enterprise 5.0.3, 5.0.4 added to provisioning options

14 November
  • Console improvements
    • Apache Cassandra ver. 3.7 (patched v2) and Datastax Enterprise 5.0.3, 5.0.4 added to provisioning options
    • Changed date format from dd/MM/yyyy to MMM d, YYYY

3 November
  • Console improvements
    • Removed availability of Datastax Enterprise as a distribution option. Please contact sales@instaclustr.com for DSE Support
    • Added a missing CSRF check to API key management form

2 November
  • Console/API and Provisioning infrastructure improvements
    • Changes to Instaclustr management architecture for improved security and reliability

October 2016


26 October
  • Console Improvements
    • Added previous/next period controls to graphs

25 October
  • Two-Factor Authentication
    • 2FA authentication added as an optional feature for all Console users.
  • Console Improvements
    • Fixed a graphing bug that displayed an error page immediately after a cluster has been provisioned.

18 October
  • Cassandra version update
    • Apache Cassandra ver. 3.9, 3.7 (patched), 3.0.9, 2.2.8 and 2.1.16 added to provisioning options
  • Console Improvements
    • SLA Latency metrics re-named to Synthetic Transactions
    • Reduced pressure on browser memory
    • Graph refresh is now much less annoying

6 October
  • Synthetic Transaction metrics
    • Synthetic transaction read and write latencies are available from dashboard and api.

September 2016


29 September
  • Console & Provisioning API Improvements
    • General minor improvements to the UI.
    • Provisioning API cluster info now exposes network and use private address broadcasting.

28 September
  • Zeppelin Update
    • released version 0.6.1 of Zeppelin with Spark Cassandra Connector 1.6.2

23 September
  • Console Improvements
    • Rack allocation displayed in cluster creation, and data centre and node addition forms.
    • Cluster details page now displays if Private Node Discovery is enabled or disabled.
  • Added third rack to AWS Sydney region
    • Clusters in AWS Asia Pacific (Sydney) now support 3 racks (availability zones).

22 September
  • OS Load now available through console and API monitoring
    • OS Load metric is now available in console monitoring view and through our monitoring API.
  • Add node process improvements
    • Automated setting of some configurations when adding nodes and data centres to a cluster to reduce manual intervention required.
  • Changes to provisioning statuses
    • Node now moves to “provisioned” as soon as AWS instance makes contact with our system. “Joining” state added for nodes where Cassandra is running but in joining state. (Billing commences on joining or running state.)

21 September

8 September

2 September

1 September
  • Monitoring Graph Improvements
    • ability to disable auto refresh
    • graphs in a fixed order
    • sort keyspace and table names alphabetically
  • Make 3.7 default C* version for new clusters and remove 2.2.x from available versions for new clusters

Need Support
Learn More

Already have an account?
Login to the Console

Experiencing difficulties on the website or console?
Status page for known incidents


Don’t have an account yet?
Sign up for a free trial

Why sign up?
To experience the ease of creating and managing clusters via the Instaclustr Console.