Data warehousing
Data warehousing captures data from a variety of sources so it can be accessed and analyzed by business analysts, data scientists and other end users. One goal is to enhance data quality and consistency for analytics uses while improving business intelligence. Read how data warehousing provides these and other unique benefits to overall data management strategy.
Top Stories
-
News
19 Nov 2024
With new Fabric features, Microsoft aims at AI development
New data management and analytics suite features include databases and a data catalog to enable enterprises to develop and operationalize advanced applications. Continue Reading
-
Feature
23 Oct 2024
Databricks lakehouse a secret weapon for WNBA's Fever
The vendor's platform has helped Pacers Sports & Entertainment -- parent company of the NBA's Pacers and WNBA's Fever -- free data from isolation to fuel an analytics-driven future. Continue Reading
-
Feature
04 Oct 2022
How to design a data architecture for business success
To gain business value from data, enterprises need to get their data architecture right – and the right business leadership and culture is critical to that Continue Reading
-
News
28 Sep 2022
Qlik unveils pair of new integrations with Databricks
One is designed to enable joint users to easily ingest data into lakehouses, while the other aims to enable potential users to experiment with the platforms on a trial basis. Continue Reading
-
Feature
23 Sep 2022
How Lufthansa is flying its data warehouse to the cloud
Moving from an on-premises data system to the cloud can be a complex operation. Lufthansa is looking to remove some of the complexity with virtualization. Continue Reading
-
News
22 Sep 2022
Google launches trio of new tools for its data cloud
The data management and analytics tools, including new data sharing and data lake platforms, are designed to let users access more data at lower expense. Continue Reading
-
News
15 Sep 2022
Google eases cloud database migration, improves Datastream
Google wants to make migrating to its new AlloyDB database easier for its users as well as provide new support for database migration from PostgreSQL. Continue Reading
-
Feature
15 Sep 2022
Ricoh modernizes its analytics with Qlik
The information management and digital services company is beginning to develop a data culture, and the BI vendor's platform has enabled new efficiencies. Continue Reading
-
News
08 Sep 2022
Snowflake, UiPath launch integration to automate data prep
The collaboration between the data cloud vendor and robotic process automation vendor will enable joint customers to automate data pipelines used to fuel business applications. Continue Reading
-
News
30 Aug 2022
Alation adds Snowflake service, updates data catalog
The vendor launched the Alation Cloud Service for Snowflake designed to enable Snowflake users to more easily use Alation's data intelligence capabilities. Continue Reading
-
News
29 Aug 2022
Teradata launches cloud-native platform, enhances BI suite
VantageCloud Lake is designed to enable wider use across organizations along with better cost control, while ClearScape Analytics adds more than 50 new capabilities. Continue Reading
-
News
24 Aug 2022
New SAS, SingleStore integration boosts speed, efficiency
The integration between the longtime data and analytics vendor and the upstart database vendor enables users to work with data in-database, which increases speed-to-insight. Continue Reading
-
News
17 Aug 2022
Cloudera users get fully managed data lakehouse platform
The vendor is expanding its set of offerings with the launch of CDP One, a service initially available only on AWS that enables serverless deployment in the cloud. Continue Reading
-
News
11 Aug 2022
GridGain, Apache Ignite founder talks in-memory databases
Nikita Ivanov details the origin of his company and discusses the growing need organizations have for real-time database processing capabilities to complete modern transactions. Continue Reading
-
Feature
09 Aug 2022
A look at Presto, Trino SQL query engines
The co-creator of the open source project at Facebook reflects on 10 years of growth as he helps lead one of its resulting tools into the future. Continue Reading
-
News
23 Jun 2022
Starburst acquires Varada to accelerate data lake queries
After a year of partnering, the data lake query vendor decided to acquire fellow Trino SQL query engine supporter Varada to help boost query performance. Continue Reading
-
Definition
16 Jun 2022
Elastic Stack (ELK Stack)
The Elastic Stack is a group of open source products from Elastic designed to help users take data from any type of source and in any format, and search, analyze and visualize that data in real time. Continue Reading
-
News
14 Jun 2022
Yellowbrick 6 advances cloud data warehouse deployments
The data warehouse vendor is growing its hybrid data warehouse capabilities with version 6.0 of its namesake platform that is now enabled to run on AWS. Continue Reading
-
News
14 Jun 2022
Snowflake Data Cloud expands with Unistore Hybrid Tables
Snowflake adds more capabilities, including support for Apache Iceberg data lake tables and both transactional and analytics workloads, with Hybrid Tables. Continue Reading
-
News
09 Jun 2022
Datamart a new self-service developer tool in Power BI
The capability, now in in preview, will enable Premium customers to build small to midsize relational databases dedicated to a single subject, without requiring code. Continue Reading
-
News
26 May 2022
Tech stock sell-off signals tough times for data vendors
In addition to lowering the values of publicly traded data, analytics and AI vendors, the stock market's decline is making it difficult for companies still in their funding phase. Continue Reading
-
Tip
24 May 2022
How to evaluate and optimize data warehouse performance
Organizations build data warehouses to satisfy their information management needs. Data warehouse optimization can help ensure that these warehouses achieve their full potential. Continue Reading
-
Tip
17 May 2022
6 key steps to develop a data governance strategy
Data governance shouldn't be built around technology, but the other way around. Existing infrastructure, executive support, data literacy, metrics and proper tools are essential. Continue Reading
-
Tip
13 May 2022
7 best practices for successful data governance programs
A comprehensive, companywide data governance program strengthens data infrastructure, improves compliance initiatives, supports strategic intelligence and boosts customer loyalty. Continue Reading
-
News
28 Apr 2022
Ocient Hyperscale Data Warehouse scales data operations
The data warehouse vendor is targeting enterprises that need to use a trillion rows of data or more for analysis, with hyperscale technology that is now ready for broader adoption. Continue Reading
-
News
21 Apr 2022
Databricks aims data lakehouse at media and entertainment
Gaming vendor Sega is using the data vendor's technology to unify its data for sales as well as game balancing to enable players to get the best experience. Continue Reading
-
Feature
13 Apr 2022
Databricks fuels analytics for Spain's top soccer league
After prioritizing data-driven decision-making over the last decade, LaLiga is now using Databricks to inform its clubs and fans about play on the field. Continue Reading
-
News
12 Apr 2022
Arcion brings change data capture platform to the cloud
Getting data out of one system and into another in the right format as quickly as possible is a challenge the Arcion Cloud service is aiming to address for organizations. Continue Reading
-
News
06 Apr 2022
Google grows cloud capabilities with BigLake data lakehouse
Google is continuing to build out its cloud data services with a new approach that will serve as a central cloud service for unifying data across different clouds and formats. Continue Reading
-
News
05 Apr 2022
Databricks enables Delta Live Tables in data lakehouse
Databricks is looking to make it easier for users to build data pipelines to extract, transform and load data from any source using a Spark SQL data query. Continue Reading
-
News
28 Mar 2022
Snowflake launches industry-specific data cloud for retail
Retail Data Cloud is the vendor's fourth industry-specific data cloud, and comes prepackaged with data sets and capabilities to enable efficient data management and analytics. Continue Reading
-
News
24 Mar 2022
DataStax Astra DB integrates real-time data streaming
The database-as-a-service vendor advanced the change data capture capabilities of its cloud database with technology from its Apache Pulsar-based streaming service. Continue Reading
-
Feature
10 Mar 2022
Cloud data platforms spark partners' consulting business
Service providers can find a range of consulting opportunities as they help clients navigate a plethora of emerging data management platforms and associated tools. Continue Reading
-
News
09 Mar 2022
Databricks extends data lakehouse platform to healthcare
Healthcare data exists in widely varying formats. Getting it into a data lake where it can be used for analytics and machine learning is a challenge Databricks is looking to meet. Continue Reading
-
News
08 Mar 2022
DataStax scales K8ssandra for cloud-native Cassandra
The real-time data vendor is out with a new release of its K8ssandra Kubernetes operator that enables organizations to deploy, configure and run the Apache Cassandra database. Continue Reading
-
News
02 Mar 2022
Dremio opens up data lakehouse with new engine
The data lakehouse vendor is expanding its cloud platform with a new SQL query engine and data metastore for data lakes that builds on top of the Apache Iceberg table format. Continue Reading
-
Definition
23 Feb 2022
operational data store (ODS)
An operational data store (ODS) is a type of database that's often used as an interim logical area for a data warehouse. Continue Reading
-
Feature
26 Jan 2022
NLP and AI boost the automated data warehouse
Businesses are working to automate as many elements of their data warehouses as they can through nascent tools like augmented analytics and natural language processing. Continue Reading
-
Tip
30 Dec 2021
Top 5 elements needed for a successful data warehouse
While conventional data warehouses may struggle to keep up with growing volumes of data, these five elements best give the ability to tap into valuable BI. Continue Reading
-
Definition
24 Nov 2021
tree structure
A tree data structure is an algorithm for placing and locating files (called records or keys) in a database. Continue Reading
-
News
23 Nov 2021
American Airlines flies its data warehouse to the cloud
The pandemic hit American Airlines hard, but its management took an optimistic view, seeing at as an opportunity to use data more effectively to improve operations. Continue Reading
-
News
16 Nov 2021
Snowflake grows cloud data platform with unstructured data
The cloud data vendor's winter release updates its data platform with new capabilities to enable organizations to query and manage more data types across different environments. Continue Reading
-
Definition
02 Nov 2021
What is a data mart (datamart)?
A data mart is a repository of data that is designed to serve a particular community of knowledge workers. Continue Reading
-
News
27 Oct 2021
Informatica goes public again as data management grows
Informatica has transformed in recent years from an on-premises software vendor to a SaaS-based subscription model in the cloud as new services for data have emerged. Continue Reading
-
Tip
19 Oct 2021
The challenges of cloud data management
Cloud platforms are expanding rapidly, causing organizations to face new cloud management challenges keeping pace with cloud data management advancements. Continue Reading
-
News
14 Sep 2021
Snowflake aims at financial services with data cloud
Snowflake launches its new Data Cloud offering as it continues to expand the range of applications and capabilities for its customers, including Western Union and Capital One. Continue Reading
-
Tip
24 Aug 2021
6 strategies to tap into data warehouse BI
Data warehouse BI benefits include data storage, summarization and transformation and can be unlocked with these six strategies leveraging cloud architectures. Continue Reading
-
Feature
17 Aug 2021
Bill Inmon's data warehouse approach tackles text analysis
Learn the fine points of a concept at the heart of 'The Textual Warehouse' a new book that aims to help organizations profit through textual analysis. Continue Reading
-
News
10 Aug 2021
Kyligence 4.5 adds Clickhouse to Intelligent Data Cloud
The open source Clickhouse OLAP database joins the Apache Kylin analytical data warehouse in a new update that provides a platform for different types of data queries. Continue Reading
-
News
24 Jun 2021
Firebolt raises $127M to fuel cloud data warehouse efforts
Firebolt looks to grow in the cloud data warehouse market with a proprietary file format and a focus on enabling developers to build data-driven apps on top of cloud data lakes. Continue Reading
-
News
27 May 2021
Google Datastream advances change data capture in the cloud
At Google's Data Cloud Summit, a new service released in preview to enable users to capture data from other sources to bring into Google's cloud data and analytics services. Continue Reading
-
News
07 Apr 2021
Yellowbrick Manager embraces Kubernetes for data warehouse
Yellowbrick is building out a new unified control plane to help users manage distributed cloud data warehouse deployments. The vendor also advanced its data lake integration. Continue Reading
-
Tip
05 Apr 2021
Data warehouse environment modernization tools and tips
A data warehouse environment is made up of many tools and systems. Read on to learn the history of the modern data warehouse and how they're currently evolving. Continue Reading
-
News
26 Mar 2021
Presto users detail what's next for open source SQL engine
The open source Presto project is gaining adoption beyond just Uber and Facebook as the need to connect and query disparate sources of data continues to be in demand. Continue Reading
-
News
17 Mar 2021
Oracle Autonomous Data Warehouse updated with new data tools
Oracle is updating its cloud data warehouse platform with new tools that aim to enable users to more easily benefit from data analytics and machine learning predictions. Continue Reading
-
News
16 Feb 2021
Matillion raises $100M for ETL to enable data middleware
The co-founder and CEO of Matillion, talks about his company’'s latest round of Series D funding and how data will be the key to success for many organizations in 2021. Continue Reading
-
News
01 Feb 2021
Databricks fueling data lakehouse goals with $1B funding round
Databricks gets a major vote of confidence from big name investors, including Franklin Templeton, as it raises new funding to help it advance its cloud data management technology efforts. Continue Reading
-
News
21 Jan 2021
Kyligence builds out data cloud for OLAP and big data
Kyligence is advancing the Apache Kylin project with a cloud-native offering that can help organizations more efficiently execute and manage data queries against large data sets. Continue Reading
-
News
08 Jan 2021
Starburst raises $100M as PrestoSQL rebrands as Trino
Starburst is advancing its enterprise data platform with new funding that will help advance its cloud efforts around the open source Trino query engine formerly known as PrestoSQL. Continue Reading
-
Guest Post
17 Dec 2020
Apache Pulsar vs. Kafka and other data processing technologies
David Kjerrumgaard looks at how the distributed messaging platform Apache Pulsar handles storage compared to Apache Kafka and other data processing technologies. Continue Reading
-
News
15 Dec 2020
AWS expands cloud databases with data virtualization
At AWS re:invent 2020 the public cloud giant unveiled enhancements to its database and analytics portfolio, including the Babelfish project for migrating from SQL Server to PostgreSQL. Continue Reading
-
News
20 Nov 2020
Yellowbrick data warehouse update boosts workload management
Hybrid cloud data warehouse vendor updates platform with self-healing cluster capabilities and a "penalty box" feature to improve workload management. Continue Reading
-
News
17 Nov 2020
Snowflake builds out data cloud with Snowpark
Snowflake is continuing to grow the capabilities of its cloud architecture with new developer and security capabilities that aim to help users optimize information. Continue Reading
-
News
14 Oct 2020
Idera targets cloud data lake market with Qubole acquisition
Qubole joins the Idera Inc. group of software companies, bringing data pipeline capabilities into the group to target customers that need more cloud data storage. Continue Reading
-
News
07 Oct 2020
SODA Foundation improves Open Data Framework
An open source data management group enhanced its Open Data Framework with the Greenland 1.1 update, improving multi-cloud file support and expanding connectivity to data storage options. Continue Reading
-
News
16 Sep 2020
Explosive Snowflake IPO advances cloud data warehouse fortunes
Snowflake goes public in a big way on the New York Stock Exchange, raising more than $3 billion as enterprises increasingly move data and analytics workloads to the cloud. Continue Reading
-
News
26 Aug 2020
Snowflake IPO shows strength of cloud data warehouse
The cloud data warehouse services vendor files for an IPO as it looks to build out and expand its data portfolio to help organizations manage and analyze data assets. Continue Reading
-
News
23 Jul 2020
Starburst advances Presto to handle Hadoop data better
Enterprise Presto SQL vendor Starburst updated its data query platform with expanded support for legacy Hadoop workloads as well as modern cloud data lake deployments. Continue Reading
-
News
14 Jul 2020
BigQuery Omni enables Google multi-cloud data analytics
Google BigQuery data analytics users can now query data across clouds from multiple providers, including AWS and Microsoft Azure, without the need to first move the data. Continue Reading
-
News
09 Jun 2020
Snowflake files for IPO after months of speculation
Cloud data warehouse vendor Snowflake took a major step toward going public on Tuesday, filing an initial public stock offering with the Securities and Exchange Commission. Continue Reading
-
News
02 Jun 2020
Snowflake expands cloud data warehouse capabilities
Snowflake is building out its platform with new integrations to enable users to more easily connect to different data sources, including Salesforce Einstein Analytics. Continue Reading
-
News
27 May 2020
Apache Pulsar joins Kafka in Splunk Data Stream Processor
Splunk is integrating open source Apache Kafka capabilities alongside Apache Pulsar support to better enable its latest Data Stream Processor release. Continue Reading
-
News
28 Apr 2020
Actian Avalanche Real-Time Connected Data Warehouse adds integration
Actian is expanding its Cloud Data Warehouse with data integration capabilities to enable users to onboard and search data from both cloud and on-premises data sources. Continue Reading
-
News
20 Apr 2020
AWS brings cloud data lake services to bear against COVID-19
AWS has set up a large cloud data lake filled with information and resources on COVID-19 in an effort to help medical researchers fight the global pandemic. Continue Reading
-
News
25 Feb 2020
Databricks Data Ingestion Network brings data to lakehouse
Databricks Ingest entered a public preview in a move by Databricks to enable a lakehouse that combines the best features of the data lake and data warehouse models. Continue Reading
-
News
11 Feb 2020
Snowflake raises $479 million to boost cloud data warehouse
Snowflake is looking to grow its data warehouse platform with new funding and a partnership with Salesforce that could differentiate its platform from rivals. Continue Reading
-
Definition
24 Jan 2020
What is Extract, Load, Transform (ELT)?
Extract, Load, Transform (ELT) is a data integration process for transferring raw data from a source server to a data system (such as a data warehouse or data lake) on a target server and then preparing the information for downstream uses. Continue Reading
-
News
14 Jan 2020
Former Hortonworks leader named new Cloudera CEO
Cloudera finds a new leader, pulling the former CEO of Hortonworks back into the fold to help set the direction for the big data Hadoop vendor as it moves forward in 2020. Continue Reading
-
Feature
13 Jan 2020
Analytics demands add loftier goals to data warehouse strategies
As the concept of storing data and the technologies needed to do it evolve, companies with set goals in mind are building their data warehouses to maximize analytics outcomes. Continue Reading
-
News
26 Sep 2019
Quilt Data emerges from stealth to enable cloud data search
Startup emerges with a new approach to organize and search cloud data storage repositories. Continue Reading
-
News
12 Sep 2019
Amazon Quantum Ledger Database brings immutable transactions
Based on technology built internally at Amazon, the tech giant's newest database provides a centralized approach for enabling a cryptographically secure ledger system. Continue Reading
-
News
15 Aug 2019
AWS Lake Formation goes GA, as cloud data lake market grows
First released in late 2018, AWS Lake Formation is now generally available and it could be the force that helps to accelerate adoption in the cloud data lake market. Continue Reading
-
News
26 Jul 2019
Cloudera open source route seeks to keep big data alive
Inspired by the IBM-Red Hat model, Cloudera goes the open source route to broaden its market as demand for Hadoop weakens and the vendor takes on big competitors like AWS. Continue Reading
-
News
03 Jul 2019
Snowflake product VP expounds on data warehouse for the cloud
In this Q&A, Christian Kleinerman, vice president of product development at cloud data warehouse vendor Snowflake, talks about the fast-moving company's plans for the next year. Continue Reading
-
News
04 Jun 2019
Vendor unveils Snowflake Data Exchange, Google Cloud integration
Snowflake Computing's data exchange marketplace aims to make data easily shared between users and providers, enable users to innovate and give providers an opportunity to monetize data. Continue Reading
-
News
03 Jun 2019
Lyftron launches universal data access platform
Lyftron launched a data access platform that uses a data hub, data insights, enterprise-wide data catalogs and lineage, and hybrid cloud management and migration to unify data. Continue Reading
-
Definition
16 May 2019
What is Data as a Service (DaaS)?
Data as a Service (DaaS) is an information provision and distribution model in which data files (including text, images, sounds, and videos) are made available to customers over a network, typically the Internet. Continue Reading
-
News
01 May 2019
Snowflake CEO Bob Muglia replaced by former ServiceNow CEO
Frank Slootman, who led ServiceNow and Data Domain through successful IPOs, is the new chairman and CEO of cloud data warehouse vendor Snowflake, replacing former CEO Bob Muglia. Continue Reading
-
Feature
04 Apr 2019
How data staging helped Walgreens transform its supply chain
Walgreens built a centralized data warehouse to give supply chain partners a better view into its data -- but analytics were slow. That's where a data staging tier came in. Continue Reading
-
Feature
21 Feb 2019
DataOps is more than DevOps for data, Delphix CTO says
Data operations is young compared to DevOps, but it is increasingly used as part of projects that put data at the center of development. Here, Delphix CTO Eric Schrock makes observations about the trend. Continue Reading
-
Feature
01 Feb 2019
Cloud data warehouse makes inroads as users spurn admin tasks
Overlooked in the run-up to Hadoop, data warehouses have found new life off premises. Cloud-based data warehouses find favor with teams that want to reduce warehouse administration. Continue Reading
-
News
22 Jan 2019
New Teradata CEO pursues cloud-based architecture
Cloud architecture, analytics and AI data processing are top innovation priorities for new Teradata CEO Oliver Ratzesberger. He talks about his goals in this Q&A. Continue Reading
-
News
30 Nov 2018
Amazon Timestream, QLDB aim to grab more DBMS users for AWS
Built-for-purpose databases target general ones, especially in the cloud. At re:Invent 2018, AWS added time-series and transaction ledger databases to expand its line. Continue Reading
-
Tip
06 Jul 2018
When to choose an S3 big data environment over HDFS storage
Selecting a storage service for big data in the cloud can be challenging. Expert David Loshin explains usage patterns that could lead organizations to Amazon Simple Storage Service. Continue Reading
-
Answer
27 Oct 2017
Dimension tables vs. fact tables: What's the difference?
Fact tables and dimension tables are used together in star schemas to support data analytics applications. But they play different roles and hold different types of data. Continue Reading
-
Answer
17 May 2017
Operational data store vs. data warehouse: How do they differ?
Operational data stores and data warehouses both store operational data, but the similarities between them end there -- and they both have a role to play in analytics architectures. Continue Reading
-
Buyer's Guide
30 Mar 2016
A buyer's guide to selecting the best data warehouse product
With several deployment options and product choices, it's difficult to know where to start. This buyer's guide helps you choose the right data warehouse product for your company. Continue Reading
-
Feature
22 Mar 2016
Five factors to help select the right data warehouse product
How big is your company, and what resources does it have? What are your performance needs? Answering these questions and others can help you select the right data warehouse platform. Continue Reading
-
Feature
10 Mar 2016
A look inside the SAP IQ column-oriented database
The SAP IQ column-oriented database is designed for large data warehouses that require high scalability, rapid data loading and optimal query performance. Continue Reading
-
Feature
09 Mar 2016
Examining the Teradata Data Warehouse
With both relational and columnar options, the Teradata Active Enterprise Data Warehouse gives companies an efficient, scalable appliance they can deploy in-house or in the cloud. Continue Reading
-
Feature
24 Feb 2016
Evaluating the key features of data warehouse platforms
Choosing between the different types of data warehouse platforms can be simplified once you know which deployment option best meets your project requirements. Continue Reading
-
Feature
17 Feb 2016
What to expect from Oracle Exadata Database Machine
Oracle Exadata Database Machine combines hardware and software to enable analytics, batch, reporting and other tasks to run simultaneously within and across databases. Continue Reading