In this week’s real-time analytics news: Databricks announced new features and enhancements to its offerings at its annual Data + AI Summit.
Keeping pace with news and developments in the real-time analytics market can be a daunting task. Fortunately, we have you covered with a summary of the items our staff comes across each week. And if you prefer it in your inbox, sign up here!
Databricks held its annual Data + AI Summit last week and announced new capabilities and enhancements to its data warehousing offerings. Items announced included:
- Advanced data warehousing and data governance capabilities highlighting the future of the modern data stack
- Databricks Marketplace and Data Cleanrooms functionality to accelerate the company’s vision for open and collaborative data sharing
- New data engineering optimizations that automatically execute batch and streaming data pipelines in the most cost-efficient manner
- Enhancements across the machine learning lifecycle to simplify MLOps at production scale.
Additionally, the company announced several contributions to popular data and AI open-source projects, including Delta Lake, MLflow, and Apache Spark.
Many companies made Databricks-related announcements at the conference. Others did not attend but also made related announcements during the week. Here is a sampling of those items:
Acceldata announced an integration with Databricks to reduce operational data complexity and maximize return on Databricks investment. Acceldata’s data observability for Databricks improves data trust, optimizes performance, and provides spend intelligence for an enterprise’s Databricks environment through a single management dashboard.
Decodable unveiled a new Delta Lake connector that is available to any Decodable user who wants to use Databricks with data in other systems. It enables ingestion of data into Databricks at the Bronze and Silver stages of the Databricks medallion data layer architecture. Using the Decodable service with the new connector, organizations can get data into Databricks to leverage the AI-driven power of Databricks but do so via a data ingestion pipeline that is less complex and simpler than present batch ingestion.
Fivetran announced it has been named Data Ingestion Partner of the Year by Databricks. The award comes as Fivetran extends its partnership with Databricks through expanded product availability and enhancements. For example, coming soon, Fivetran’s high-volume data replication managed service will be made native for Databricks on Microsoft Azure, Amazon Web Services (AWS), and Google Cloud.
Immuta announced that it has strengthened its partnership with Databricks by integrating its policy enforcement engine into Databricks Unity Catalog. Now, Databricks customers can enforce data access policy across workspaces without allowing Databricks workspace admins to bypass or change permissions on said policies.
Matillion announced that Matillion ETL is available now on Databricks Partner Connect. Matillion ETL for Delta Lake on Databricks delivers easy-to-use, cloud-native data integration and transformation for the lakehouse, enabling more users to take advantage of the lakehouse architecture. Availability in Partner Connect allows customers to easily bring business-critical data from applications, files, and databases into the Databricks Lakehouse Platform without any pre-configuration.
Sigma Computing (“Sigma”) announced a new partnership and integration with Databricks. With Sigma’s no-code spreadsheet interface, data is made directly accessible to users to drive better insights and data-led decision-making in every department of a business. Some of the top Sigma for Databricks benefits include dynamic, live data for analytics; accessible and intuitive access for every user; ability to build data products faster; and users can drill down for deeper, granular data insights themselves via Sigma’s spreadsheet-like interface.
Snowplow announced a partnership with Databricks. With the new partnership, joint customers and the open-source community can integrate and build data-driven applications and composable customer data platforms (CDPs) with Snowplow’s AI-ready, behavioral data in real-time on the Databricks Lakehouse Platform. In addition, data teams can now access Snowplow’s custom-built web models and leverage behavioral data to power AI/ML data applications, advanced analytics, and automate insight as part of a composable CDP directly from their Databricks Lakehouse.
Tellius announced a partnership with Databricks to give joint customers the ability to run Tellius natural language search queries and automated insights directly on the Databricks Lakehouse Platform, powered by Delta Lake, without the need to move any data. Connecting to Delta Lake on Databricks only takes a few clicks, and then users can perform a natural language search of their unaggregated data to answer their own questions.
Real-time analytics news in brief
DataStax announced the general availability (GA) of Astra Streaming, an advanced, fully-managed messaging and event streaming service built on Apache Pulsar. Now featuring built-in API-level support for Kafka, RabbitMQ, and Java Message Service (JMS), Astra Streaming makes it easy for enterprises to get real-time value from all their data-in-motion.
Kyligence announced Kyligence Zen, an intelligent metrics store platform that helps to align business goals and key metrics. The new platform automates data pipelines from data lakes or data warehouses to its multidimensional OLAP database to deliver metrics consistency and data trust in a cost-effective way. Kyligence Zen is built on top of Kyligence’s OLAP platform and leverages its AI-Augmented engine to identify datasets and metrics automatically.
TigerGraph announced new features to TigerGraph Cloud, its fully managed graph database as a service. The new capabilities, natively built for the cloud, offer enhancements that enable seamless adoption, deployment, and management of multiple graph database solutions. The latest features include enterprise IAM (Identity and Access Management), single login, secure enterprise connectivity, global coverage expansion, and free-tier available on Azure.
Hewlett Packard Enterprise unveiled platform enhancements and new cloud services for HPE GreenLake. The enhancements include a reimagined modern private cloud that provides a cloud-native experience to power an organization’s hybrid strategy, regardless of location. In addition, HPE unveiled eight new HPE GreenLake cloud services, giving users more choice, control, and predictability for their enterprise cloud delivery.
Yugabyte announced the general availability of YugabyteDB 2.15 and unveiled a new service, YugabyteDB Voyager. YugabyteDB 2.15 gives engineering and operations teams a unified platform to run all their business-critical transactional applications. YugabyteDB Voyager, the new cloud database migration service, accelerates cloud-native adoption by making the move to a distributed database simple and efficient.
Siemens launched an open digital business platform, Siemens Xcelerator, to accelerate digital transformation and value creation for customers of all sizes in industry, buildings, grids, and mobility. The platform includes a curated portfolio of internet of things (IoT) enabled hardware, software, and digital services from across Siemens and certified third parties; a growing ecosystem of partners; and an evolving marketplace to facilitate interactions and transactions between customers, partners, and developers.
Altair announced it has launched the Altair Unlimited data analytics appliance, an all-in-one turnkey solution. The appliance – which is built on Dell PowerEdge R750 servers – is designed to foster enterprise-wide, data-driven strategies by giving teams the power to use data analytics and AI to gain competitive advantages and drive next-level business results.
Digital Realty has announced that it has launched Data Hub featuring HPE GreenLake Colocation on PlatformDIGITAL. The combination of these two solutions on Digital Realty’s global platform creates an ideal place for enterprises to bring their data together and consume infrastructure on demand, helping to unlock trapped value and drive innovation.
NVIDIA announced its NVIDIA AI Enterprise suite for AI and data analytics software is now available through HPE Greenlake in select countries. With this arrangement, organizations can access the NVIDIA AI Enterprise software suite as an on-prem cloud service from HPE, reducing the risk, duration, effort, and cost for IT staff to build, deploy and operate an enterprise AI platform.
Dynatrace announced it has extended the Dynatrace platform’s release validation capabilities to automatically deliver user experience validation and user experience assurance (UXA) at every stage of the software development lifecycle (SDLC). By automatically incorporating user experience insights, the Dynatrace platform allows DevOps and SRE teams to continuously evaluate their applications against specific, measurable, and achievable service level objectives (SLOs).
Datadobi announced its StorageMAP solution is fully integrated with Amazon FSx for NetApp ONTAP, a fully managed shared storage solution built on NetApp’s ONTAP file system. Amazon FSx for NetApp ONTAP customers can now use StorageMAP’s analytics to understand the characteristics of the full unstructured data storage estate and leverage actions to relocate data as needed.
Moxa launched the new AIG-300 Series of IIoT gateways. Optimized for seamless integration with the Microsoft Azure IoT Edge computing platform, AIG-300 gateways provide the connectivity needed in distributed and unmanned sites to collect, store, process, and analyze operational data from sensors and other IIoT devices.
CircleCI announced new security and automation capabilities to its self-hosted runners. CircleCI’s self-hosted runners bring CircleCI’s cloud to any unique infrastructure or compliance use case, allowing enterprise-level teams or those in highly regulated industries the ability to build and test on a wider variety of architectures, as well as have additional control over the environment. Self-hosted customers can now take advantage of test splitting and enhances access and control.
Partnerships, collaborations, and more
MinIO announced a partnership with Snowflake to make data stored on MinIO available to Snowflake customers regardless of where that data resides. Joint customers of MinIO and Snowflake will be able to query and analyze multiple data sources residing on MinIO with the Snowflake Data Cloud. This partnership will allow customers to utilize the capabilities of the Snowflake Data Cloud without incurring the cost of moving data.
Cloudian announced a partnership with Vertica, a Micro Focus line of business, providing organizations with a public cloud-like modern data warehousing solution, on-premises, for managing their AI/ML and other analytics workloads securely behind their firewall. Vertica’s separation of compute and storage scaling of its underlying analytical database allows customers to use Cloudian’s HyperStore native S3-compatible object storage as a single location to store all their data.
SUSE expanded its partnership with Hewlett Packard Enterprise (HPE) to further enhance HPE GreenLake’s edge-to-cloud services platform offering. SUSE Rancher, K3s, and SUSE Linux Enterprise enable customers to deploy and manage HPE GreenLake workloads at the distributed enterprise edge.
Hewlett Packard Enterprise announced its long-time partner, Red Hat, is joining the HPE GreenLake ecosystem. The companies will work together to combine new service offerings with Red Hat’s pioneering open-source technologies, such as Red Hat OpenShift, Red Hat Enterprise Linux, and Red Hat Ansible Automation Platform, all deployed on the HPE GreenLake platform.
Soracom announced that ThingsMatrix has joined the Soracom Partner Space – a growing ecosystem for building and scaling IoT applications to advance asset monitoring for industrial enterprises. In collaborating with ThingsMatrix, Soracom is able to offer a proven portfolio of solutions to its customers and ecosystem partners looking to improve their asset monitoring capabilities.
If your company has real-time analytics news, send your announcements to [email protected].
In case you missed it, here are our most recent previous weekly real-time analytics news roundups:
