In this week’s real-time analytics news: AWS re:Invent in Las Vegas drew huge crowds and had many announcements about new services and partnerships.
Keeping pace with news and developments in the real-time analytics market can be a daunting task. Fortunately, we have you covered with a summary of the items our staff comes across each week. And if you prefer it in your inbox, sign up here!
Amazon Web Services (AWS) announced two new integrations at its re:Invent conference this week that make it easier for businesses to connect and analyze data across data stores without having to move data between services.
Specifically, the new capabilities enable businesses to analyze Amazon Aurora data with Amazon Redshift in near real time, eliminating the need to extract, transform, and load (ETL) data between services. Businesses can also now run Apache Spark applications on Amazon Redshift data using AWS analytics and machine learning (ML) services (e.g., Amazon EMR, AWS Glue, and Amazon SageMaker).
The announcements were touted as a prelude to what AWS CEO Adam Selipsky called a zero-ETL future. (Read more about these specific announcements here.) Other AWS announcements at the conference included:
- AWS Clean Rooms, a new analytics service that helps companies easily and securely analyze and collaborate on their combined datasets—without sharing or revealing underlying data. AWS Clean Rooms provides a broad set of built-in data access controls that protect sensitive data, including query controls, query output restrictions, query logging, and cryptographic computing tools.
- Five new capabilities to help customers streamline business intelligence (BI) operations using Amazon QuickSight, the serverless BI service built for the cloud. This announcement expands QuickSight Q, a natural language querying capability, to support forecast and “why” questions and automate data preparation.
- Five new capabilities across its database and analytics portfolios that make it faster and easier for customers to manage and analyze data at petabyte scale. These new capabilities for Amazon DocumentDB (with MongoDB compatibility), Amazon OpenSearch Service, and Amazon Athena make it easier for customers to run high-performance database and analytics workloads at scale.
- A new capability for AWS Glue to automatically manage data quality across data lakes and data pipelines. As a result, Amazon Redshift now offers support for a high availability configuration across multiple AWS Availability Zones (AZs).
- AWS Supply Chain, a new application that helps businesses increase supply chain visibility to make faster, more informed decisions. AWS Supply Chain automatically combines and analyzes data across multiple supply chain systems so businesses can observe their operations in real-time, find trends more quickly, and generate more accurate demand forecasts.
- Amazon Security Lake, a service that automatically centralizes an organization’s security data from cloud and on-premises sources and manages the data throughout its lifecycle. It converts incoming security data to the Apache Parquet format and conforms it to the Open Cybersecurity Schema Framework (OCSF) open standard to make it easier to normalize security data from AWS and combine it with pre-integrated third-party enterprise security data sources.
Also at re:Invent, StreamSets, a Software AG company, announced the launch of StreamSets Mainframe Collector, a new solution that helps companies unlock data from their mainframe systems for cloud analytics. StreamSets Mainframe Collector connects to mainframe data sources through a lightweight listener to avoid high additional costs and presents data in a relational format, allowing users to easily find, understand, and include the data in their cloud analytics efforts. The solution offers:
- Fast and easy installation and setup in hours vs. weeks
- Easy and intuitive data access presented in relational format and queried with SQL.
- Reliable delivery to modern data platforms, including Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform, Snowflake, and Databricks.
Wipro Limited announced the launch of Wipro Data Intelligence Suite, a one-stop solution for accelerating cloud modernization and data monetization, focused on modernizing data estates, including data stores, pipelines, and visualizations, running on Amazon Web Services (AWS). The solution offers a reliable and secure means to migrate from existing platforms and fragmented legacy systems to the cloud.
Real-time analytics news in brief
Anaconda announced the availability of Anaconda Notebooks on-premises. Following last month’s unveiling of cloud-hosted Anaconda Notebooks, Notebooks are now available to customers as an add-on to Anaconda’s on-premises repository solution. This implementation of Anaconda Notebooks is a tightly integrated JupyterHub instance.
Anyscale, the company behind Ray open source, the unified compute framework for scaling machine learning or Python workloads, announced several new advancements to its Anyscale Platform. The new capabilities extend beyond the advantages of Ray open source to make AI/ML and Python workload development, experimentation, and scaling even easier for developers. For example, the new Anyscale Workspaces environment, now available for early access, provides a unified and seamless developer experience to scale ML workloads from a laptop to the cloud with no code changes.
Code Intelligence announced its open-source Command-Line Interface (CLI) tool, CI Fuzz CLI, now allows Java developers to easily incorporate fuzz testing into their existing JUnit setup to find functional bugs and security vulnerabilities at scale. CI Fuzz CLI leverages genetic and evolutionary algorithms as well as automated instrumentation to dynamically generate millions of unusual inputs to test applications for unexpected behaviors that may lead to serious vulnerabilities.
Dremio announced key features for writing and updating data, enhanced support for semi-structured data, and expanded BI and data ecosystem integrations. Some highlights of the new offerings for the open data lakehouse solution include DML and time travel, additional new SQL functionality, security enhancements, performance improvements, and Usability updates.
EnterpriseDB (“EDB”) announced the availability of EDB Tools and Extensions Release for PostgreSQL 15 (EDB PG 15). With EDB PG 15, EDB supports PostgreSQL 15.1 wherever enterprises want to deploy, whether on-premises, in the cloud, self-managed, or fully managed with EDB BigAnimal, EDB’s fully managed database-as-a-service. The release also supports EDB Postgres for Kubernetes, which leverages CloudNativePG. Other features in the release include EDB Advanced Storage Pack, EDB Postgres Tuner, and EDB LDAP Sync.
Matillion announced technical and cloud ecosystem partnerships to accelerate the value of data within enterprises. Its Data Productivity Cloud, a data integration platform that allows teams of all skill levels to deliver business-ready data through cloud-native ELT (data extract, load, and transform), now offers a number of new integrated accelerators, including Healthcare Data Integration in Snowflake, AWS Redshift Serverless Scale, AllCloud’s Matillion One Click solution, and Collibra integration for end-to-end data lineage.
OpsMx announced new software modules and support services for Argo that make it faster, easier, and safer for enterprises to use open-source Argo in production. New automated analysis increases the speed and accuracy of complex progressive deployments. A unified view and centralized audit of activity across distributed Argo clusters is available from new management dashboards. New 24×7 support ensures production-grade availability and security.
Qlik announced that its suite of SAP Accelerators is now available on Qlik Cloud Data Integration, its Enterprise Integration Platform as a Service (eiPaaS). These pre-configured solution templates address the entire data supply chain for SAP data, from real-time ingestion and automated transformation through the delivery of analytics-ready data and BI dashboards in the cloud.
Veza announced that its Open Authorization API (OAA) is now public on GitHub for community collaboration, extending the reach of identity-first security across the enterprise. Developers can now create and share connectors to extend the Veza Authorization Graph to all sensitive data, wherever it lives, including cloud providers, SaaS apps, and custom-built internal apps.
Partnerships, collaborations, and more
Many companies used the re:Invent conference to announce partnerships and collaborations with AWS. Some of the key news items include:
Atos announced it developed, in collaboration with AWS, Atos’ AWS Data Lake Accelerator for SAP, a new solution enabling customers to accelerate and accurately manage business key performance indicators (KPIs) by allowing easy access for both SAP and non-SAP data silos.
AWS and Atos announced a Global Strategic Transformation Agreement that enables Atos customers with large-scale infrastructure outsourcing contracts to accelerate workload migrations to the cloud and achieve digital transformation.
AWS and Slalom announced a multiyear extension to the companies’ global Strategic Collaboration Agreement (SCA). The two companies will work together to develop vertical solutions and accelerators on AWS for customers by delivering specialized end-to-end cloud migration and to help accelerate their cloud journeys.
Couchbase has expanded its strategic partnership with AWS to offer customers integrated go-to-market activities, commercial incentives, and technology integrations. This includes migrating workloads to the Couchbase Capella Database-as-a-Service offering on AWS, as well as extending Capella App Services to run on AWS edge services.
Cribl announced its integration with Amazon Security Lake and full support for the Open Cybersecurity Schema Framework (OSCF).
Descartes Labs announced it is migrating its core information technology (IT) infrastructure, including its geoprocessing and analytics platforms, to AWS.
Domo announced it has joined the Amazon SageMaker Ready Program. This designation helps customers discover partner software solutions that are validated by AWS Partner Solutions Architects to integrate with Amazon SageMaker.
Fortanix today announced that Fortanix Data Security Manager (DSM) now works with the AWS KMS External Key Store (XKS), allowing organizations that deal with regulated data to run workloads on AWS by segregating data on AWS infrastructure from encryption keys.
Granulate, an Intel Company, announced support for the AWS for Advertising & Marketing initiative from Amazon Web Services (AWS) to help accelerate advertising and marketing transformation.
Harness announced Harness Cluster Orchestrator to allow customers to optimize and reduce their Kubernetes cloud workload costs with Amazon Elastic Compute Cloud (Amazon EC2) Spot instances from AWS.
HiveMQ announced the availability of the HiveMQ Enterprise Extension for Amazon Kinesis, a new feature that allows users to quickly move their MQTT data from the broker into AWS using Amazon Kinesis Data Streams. With this release, HiveMQ customers can now integrate MQTT data reliably and securely to any of the three major cloud providers.
Informatica announced the launch of a new suite of cloud data management services for Amazon Web Services (AWS) geared towards democratizing data to departmental users, developers, data scientists, and data engineers across all skill levels.
PagerDuty announced its PagerDuty Process Automation is now available in AWS Marketplace. PagerDuty Process Automation can be purchased in AWS Marketplace as either a fully hosted and managed software as a service (SaaS) or through a customer-managed solution.
Planview announced that it selected AWS as its preferred public cloud provider. Planview is using AWS’s portfolio of cloud technologies and solutions to drive the efficiency, security, and reliability needed to scale Planview’s connected platform of solutions.
Precisely announced that it has achieved the Amazon Relational Database Service (Amazon RDS) Ready Product designation. This designation recognizes that the Precisely Connect data integration solution has demonstrated successful integration with Amazon RDS.
Precisely also announced it is working with AWS on its AWS Mainframe Modernization service. The integration offers real-time replication of mainframe data to AWS leveraging Precisely Connect, allowing customers to migrate data securely and efficiently, as well as access mainframe data on AWS for more powerful analytics.
Rafay Systems launched its Cost Management Service, a new offering integrated into its Kubernetes Operations Platform (KOP) to deliver Kubernetes cloud cost optimization across clusters located in public clouds and on-premise data centers.
Red Hat announced an expansion of its open solutions publicly available in AWS Marketplace. Customers can now use committed AWS spend to purchase and run Red Hat offerings directly through AWS Marketplace.
Semtech Corporation announced that it has entered a strategic agreement with AWS to license its LoRa Cloud global navigation satellite system (GNSS) geolocation services to help the AWS global developer community build asset tracking and monitoring solutions and connect Internet of Things (IoT) enabled devices, using LoRa Edge, to the cloud.
SnapLogic announced updates to its Partner Connect Program, which empowers AWS Partners, ISVs, and OEMs to use SnapLogic’s low-code platform to quickly build integrations on behalf of their clients. The program offers help with technical, functional, and industry vertical specializations.
SoftwareONE announced that it has achieved the Amazon Web Services (AWS) Premier Tier Services Partner status in the AWS Partner Network (APN).
Stability AI announced that it has selected AWS as its preferred cloud provider to build and scale its AI models for content generation. Stability AI uses Amazon SageMaker, as well as AWS’s compute infrastructure and storage, to accelerate its work on open-source generative AI models.
Starburst announced a new Starburst Enterprise support with AWS Lake Formation to help joint customers implement the technical aspects of data mesh.
Starburst also announced the launch of foundational Data Products capabilities for its managed service, Starburst Galaxy. New data and schema discovery and data privileges capabilities simplify and streamline the traditional ETL process for the curation of Data Products, accelerating data querying, access and analytics across the organization.
UST announced that it is working on solution development and go-to-market strategies targeting the financial services industry with AWS and Mendix. The effort will leverage AWS infrastructure, Mendix’s low-code application development platform, and UST’s solutions for application modernization.
Vectra AI announced Vectra Cloud Detection and Response now works with Amazon Security Lake from Amazon Web Services (AWS). With Security Lake, customers can use the security and analytics solutions of their choice to simply query that data in place or ingest OCSF-compliant data.
Other real-time analytics news announcements not related to the conference
AtScale announced the availability of its semantic layer solutions on Google Cloud Marketplace, providing customers with a cloud-first approach for delivering interactive analytics applications, including business intelligence (BI) and enterprise artificial intelligence (AI).
CData Software announced that it has successfully achieved the Service Organization Control (SOC) 2 Type 1 certification following an audit conducted by LBMC. This independent validation of security controls affirms that CData’s information security practices, policies, and operations meet the strict standards established by the American Institute of Certified Public Accountants (AICPA).
Exxact Corporation announced that it now offers Run:ai in its solutions. This Kubernetes-based orchestration tool incorporates an AI-dedicated, high-performant super-scheduler tailored for managing GPU resources in AI clusters. By partnering with Run:ai, Exxact can help developers achieve performance efficiency in AI building, training, and inferencing workloads.
Equalum announced a strategic partnership with Yellowbrick Data. The partnership leverages the Equalum platform to enable a more simple, efficient, and higher-performance migration of data from legacy environments to the Yellowbrick Data Warehouse hosted in the user’s preferred commercial cloud environment.
Syntropy announced a partnership with Zenlayer to provide enhanced network capacity to global Web3 network users. Under the agreement, Zenlayer will bring its edge infrastructure to the Syntropy network through the Open Bandwidth Exchange (OBX), giving Syntropy’s users access to instantly scalable, high-performing network services.
Teradata and Vcinity announced an alliance that lowers the barrier for connecting data over long network distances in cloud, hybrid, or on-prem environments. Using the Teradata VantageCloud offering with Vcinity’s technology, organizations can more easily connect and leverage data that is slow to access or is physically very far away.
If your company has real-time analytics news, send your announcements to [email protected].
In case you missed it, here are our most recent previous weekly real-time analytics news roundups:
- Real-time Analytics News for Week Ending November 19
- Real-time Analytics News for Week Ending November 12
- Real-time Analytics News for Week Ending November 5
