Data integration
Most organizations draw data from multiple sources, including external ones. Data integration combines this data to create unified sets of information for tracking business performance and managing operations. Learn about data integration strategies to ensure information from multiple sources is consistent to meet users' data analysis needs across the organization.
Top Stories
-
Tip
12 Jul 2024
7 data modeling techniques and concepts for business
Three types of data models and various data modeling techniques are available to data management teams to help convert data into valuable business information. Continue Reading
-
News
10 Jul 2024
Graph technology helps battle election misinformation
Backed by a grant from Neo4j, including free use of its platform, Syracuse University is exposing coordinated networks that spread election misinformation on social media. Continue Reading
-
News
11 Mar 2022
Instaclustr to support Karapace open source schema registry
Instaclustr is joining rival Aiven in an effort to support an open source technology that brings REST proxy and schema technology to Kafka event streaming. Continue Reading
-
News
10 Mar 2022
Collibra Data Intelligence Cloud update targets productivity
The vendor's new and enhanced features are aimed at improving user efficiency and include a new browser extension along with added data governance capabilities. Continue Reading
-
News
09 Mar 2022
An analyst's blueprint for choosing a cloud data platform
Though choosing the tools that best fit the needs of an organization is difficult, analyst Doug Henschen has come up with a series of steps that can serve as a guide. Continue Reading
-
News
07 Mar 2022
Fannie Mae, Mercedes-Benz detail data lake platform uses
At the Subsurface Winter 2022 virtual conference, several organizations including Fannie Mae and Mercedes-Benz explained why and how they are using Dremio's data lake engine. Continue Reading
-
News
04 Mar 2022
Directus brings Open Data Platform technology to the cloud
The vendor's new managed cloud service is designed to enable organizations to connect applications, business intelligence and websites to data sources and databases. Continue Reading
-
Definition
02 Mar 2022
data ingestion
Data ingestion is the process of obtaining and importing data for immediate use or storage in a database. Continue Reading
-
News
02 Mar 2022
Anomalo Pulse dashboard aims for data quality insights
The startup is enhancing its platform by providing users with a new dashboard that brings visibility into the state of data used for data analytics and business intelligence. Continue Reading
-
News
02 Mar 2022
Alteryx unifies cloud capabilities in a single platform
The longtime data and analytics vendor launched Analytics Cloud, bringing together its first four cloud-native capabilities in one environment for a more seamless user experience. Continue Reading
-
News
28 Feb 2022
DBT Labs raises expectations for data transformation
DBT Labs co-founder and CEO Tristan Handy outlines his view on the modern data stack, how the vendor's technology powers data pipelines and why he raised money now. Continue Reading
-
News
24 Feb 2022
Ahana aims to improve Presto data lake security in the cloud
Data startup Ahana has updated its Presto cloud platform with integrated governance and control capabilities for data lake deployments. Continue Reading
-
Feature
24 Feb 2022
MetLife improves efficiency with Tibco Data Virtualization
The insurance giant's investment management division has reduced its data integration process from weeks to hours since adopting the analytics vendor's technology in 2017. Continue Reading
-
Feature
24 Feb 2022
Christal Bemont, Talend CEO: Show up as yourself
Christal Bemont, CEO of data management firm Talend, reflects on coming through difficult times in solidarity with co-workers, and how data quality assumes a heightened significance in the digital era Continue Reading
-
News
23 Feb 2022
Couchbase Mobile 3 brings NoSQL database to the edge
The vendor looks to integrate an edge-to-cloud database architecture with a new release that provides developers with tools to manage distributed database deployments. Continue Reading
-
News
23 Feb 2022
Voltron Data takes aim at data management with Apache Arrow
CEO and co-founder Josh Patterson outlines the promise of the new language-agnostic data analytics development framework and why the vendor is raising big money to support it. Continue Reading
-
News
23 Feb 2022
Alteryx makes personnel changes to navigate cloud journey
The longtime data management vendor has remade its C-suite over the past few years, including adding a new CEO and president, as it modernizes its technology. Continue Reading
-
News
17 Feb 2022
Hyperledger expands open source blockchain efforts
The CTO of a major blockchain group provides insight into the growing effort to build open source blockchain technologies for enterprises, though challenges remain. Continue Reading
-
News
09 Feb 2022
Reverse ETL vendor Census raises $60M
Census raises new money as the vendor ramps up its operations to help organizations get data from data warehouses to power large-scale business applications. Continue Reading
-
News
18 Jan 2022
Fivetran updates data integration platform with dbt Core
With automated data transformations and new data lineage visualization graphs, Fivetran is looking to make building data pipelines easier for data users. Continue Reading
-
Tip
05 Jan 2022
10 big data challenges and how to address them
Bringing a big data initiative to fruition requires an array of data skills and best practices. Here are 10 big data challenges enterprises must be ready for. Continue Reading
-
News
13 Dec 2021
SnapLogic raises $165M to fund AI data integration
The data integration vendor's fundraising success shows the growth the iPaaS and RPA markets have seen in recent years, with a steady pace of investment and acquisitions. Continue Reading
-
Definition
08 Oct 2021
semantic technology
Semantic technology is a set of methods and tools that provide advanced means for categorizing and processing data, as well as for discovering relationships within varied data sets. Continue Reading
-
Definition
04 Oct 2021
data silo
A data silo exists when an organization's departments and systems cannot, or do not, communicate freely with one another and encourage the sharing of business-relevant data. Continue Reading
-
Definition
01 Oct 2021
data fabric
A data fabric is an architecture and software offering a unified collection of data assets, databases and database architectures within an enterprise. Continue Reading
-
News
19 Aug 2021
Hitachi Vantara expands Lumada DataOps suite
Hitachi Vantara integrated its data management technologies into a new product suite intended to help organizations with data operations. Data governance is coming next. Continue Reading
-
Definition
19 Aug 2021
stream processing
Stream processing is a data management technique that involves ingesting a continuous data stream to quickly analyze, filter, transform or enhance the data in real time. Continue Reading
-
News
11 Aug 2021
Talend updates data fabric with more collaboration
With its summer 2021 update, data integration vendor Talend boosted its data sharing and integration features to help business users share trusted data sources. Continue Reading
-
Feature
06 Aug 2021
Why City Furniture embraced data virtualization
With data coming from on-premises and cloud sources and spanning legacy systems, databases and even flat files, City Furniture faced problems bringing all its data together. Continue Reading
-
Tip
28 Jul 2021
Data architecture vs. information architecture: How they differ
Data architects collect the statistics and information architects put the numbers into context as they work symbiotically to bolster an enterprise's data and business strategies. Continue Reading
-
Tip
23 Jul 2021
9 steps to a dynamic data architecture plan
Learn the nine steps to a comprehensive data architecture plan, including C-suite support, data personas, user needs, governance, catalogs, SWOT, lifecycles, blueprints and maps. Continue Reading
-
Tip
22 Jul 2021
6 key components of a successful data strategy
These six elements are essential parts of an enterprise data strategy that will help meet business needs for information when paired with a solid data architecture. Continue Reading
-
Tip
20 Jul 2021
5 principles of a well-designed data architecture
Here are five core data architecture principles to help organizations build a modern architecture that successfully meets their data management and analytics needs. Continue Reading
-
Tip
16 Jul 2021
How to build a successful cloud data architecture
As enterprises vacate the premises and migrate their operations skyward, a cloud data architecture can provide the long-term flexibility to improve workflows, costs and security. Continue Reading
-
Tip
13 Jul 2021
Data modeling vs. data architecture: What's the difference?
Data modelers and data architects have distinctly different roles, but they work in a complementary fashion to help enterprises unlock and capitalize on data's business value. Continue Reading
-
Feature
07 Jul 2021
Meltano spins out from GitLab to advance DataOps platform
Douwe Maan, founder and CEO of Meltano, outlines the new data startup's approach as it raises seed funding to advance an open source ELT system. Continue Reading
-
Feature
28 Jun 2021
What an automated data integration implementation means
Automated data integration can reduce time spent by data professionals on repetitive tasks. Learn about strategies to help implement automated data integration. Continue Reading
-
News
25 Jun 2021
Fivetran looks to Teleport Data for database replication
Fivetran is expanding its data integration capabilities with data validation technology that takes a different approach than change data capture for database replication. Continue Reading
-
News
11 May 2021
K2View updates DataOps platform with data fabric automation
A data operations platform vendor is bringing new capabilities to its data platform that will help organizations more easily integrate and automate the movement of data. Continue Reading
-
Feature
23 Apr 2021
Establish big data integration techniques and best practices
A big data integration strategy departs from traditional techniques, embraces several data processes working together and accounts for the volume, variety and velocity of data. Continue Reading
-
News
21 Apr 2021
Oracle brings GoldenGate data integration service to cloud
Oracle is making its GoldenGate real-time data technology available on its second-generation Oracle Cloud Infrastructure platform, as well as enabling multi-cloud operations. Continue Reading
-
News
16 Mar 2021
Starburst and Varada partner for Trino data platform effort
Managing Trino, the open source project formerly known as PrestoSQL, could get easier and faster with a new partnership from two leading vendors in the market. Continue Reading
-
News
12 Mar 2021
Flatfile looks to be universal translator for data loading
Startup raises new funding to help advance its vision for making it easier for business users to extract, load and transform data from one source to another. Continue Reading
-
News
09 Mar 2021
Apache Daffodil advancing Data Format Description Language
Data integration and data loading efforts could get easier to execute, as open source DFDL project becomes a Top-Level Project at the Apache Software Foundation. Continue Reading
-
News
02 Mar 2021
Airbyte set to advance open source data integration platform
The CEO of a data integration startup explains how he is looking to grow the technology and community behind the vendor's open source data extract and loading platform. Continue Reading
-
News
18 Feb 2021
Grafana Enterprise brings observability stack on premises
Grafana Labs is launching a new on-premises project stack for data observability, based on a series of open source projects that the company leads or supports. Continue Reading
-
Feature
11 Feb 2021
Talend CEO talks about vendor's growth strategy
With its cloud business a primary driver of growth, Talend is progressing toward the goal of increasing annual revenue from $250 million to $1 billion. Continue Reading
-
News
05 Feb 2021
Hazelcast Jet 4.4 brings SQL to stream processing engine
Hazelcast Jet brings new SQL query capabilities to the stream processing platform that will enable developers to continuously query streaming data without interrupting data flow. Continue Reading
-
Feature
22 Jan 2021
Data fabrics help data lakes seek the truth
Data fabrics can play a key role in aligning business goals with the integration, governance, reliability and democratization of information collected in massive data lakes. Continue Reading
-
News
20 Jan 2021
Fivetran data connectors boost enterprise data integration
An enterprise data integration vendor is building out its suite of data connectors with updates for organizations to create data pipelines for business processes and analytics. Continue Reading
-
Definition
04 Jan 2021
feature engineering
Feature engineering is the process that takes raw data and transforms it into features that can be used to create a predictive model using machine learning or statistical modeling, such as deep learning. Continue Reading
-
News
22 Dec 2020
Ascend aims to ease data ingestion with low-code approach
Data platform vendor Ascend has announced a new low-code approach to building out data pipelines on cloud data lakes to accelerate analysis and insights. Continue Reading
-
Feature
16 Dec 2020
Data anonymization best practices protect sensitive data
See how data anonymization best practices can help your organization protect sensitive data and those who could be at risk if that data identified them. Continue Reading
-
Feature
10 Dec 2020
The top 6 use cases for a data fabric architecture
Enterprise data fabric adoption has been on the rise as a way to ensure access and data sharing in a distributed environment. Here are the top use cases for data fabrics. Continue Reading
-
News
10 Dec 2020
Varada accelerates data virtualization with Presto
The new Varada Data Platform combines data virtualization with the open source Presto SQL query engine to help enable rapid searches on cloud data lakes. Continue Reading
-
Definition
21 Nov 2020
Google BigQuery
Google BigQuery is a cloud-based big data analytics web service for processing very large read-only data sets. Continue Reading
-
News
08 Oct 2020
Denodo Platform 8.0 expands data virtualization features
The updated platform from Denodo looks to help organizations via enhanced features that connect and query disparate sources of data across different environments. Continue Reading
-
Feature
28 Aug 2020
Investment in talent key for data quality in healthcare
Investing in training employees on proper data gathering and management practices is crucial for healthcare organizations seeking to ensuring data quality and patient care. Continue Reading
-
Feature
18 Aug 2020
Informatica CEO outlines digital transformation challenges
Informatica chief Amit Walia gives insight into what organizations need most to enable digital transformation and why enterprise data management is at the foundation. Continue Reading
-
News
08 Jul 2020
SODA Foundation launches to unify open source data management
A new Linux Foundation-sponsored group will support open source data management and promote interoperability between applications and data sources, on premises or cloud-based. Continue Reading
-
News
07 Jul 2020
Informatica expands enterprise data catalog capabilities
Informatica brought new features to its enterprise data catalog, including Data Asset Analytics, a tool to help organizations understand the value of their data. Continue Reading
-
News
30 Jun 2020
Fivetran raises $100M to advance enterprise data integration
The co-founder and CEO of Fivetran talks about what the vendor is doing to help organizations meet the challenges of enterprise data integration. Continue Reading
-
Tip
23 Jun 2020
Trusted data is among governance, data integration benefits
Well-conceived governance programs injected with data integration tools can overcome the inherent distrust companies have in their own data stored in multiple systems. Continue Reading
-
News
18 May 2020
Grafana 7.0 from Grafana Labs expands data visualization
Distributed tracing data joins log metrics in Grafana 7.0 release, providing users with more ways to connect, observe and visualize data coming from different services. Continue Reading
-
Feature
30 Apr 2020
How a logical data fabric can improve data management
As data continues to grow across different sources, speakers at the Fast Data Strategy virtual summit outline how a logical data fabric approach can help. Continue Reading
-
Tip
09 Apr 2020
Developing an enterprise data strategy: 10 steps to take
Consultants detail 10 to-do items for data management teams looking to create a data strategy to help their organization use data more effectively in business operations. Continue Reading
-
News
17 Mar 2020
Hazelcast Jet 4.0 boosts event streaming data platform
The vendor's real-time event streaming platform gets a boost as the newest version adds support for Python machine learning models to help make sense of the data deluge. Continue Reading
-
News
09 Mar 2020
Matillion Data Loader goes GA: No-code tool addresses data ingestion
Matillion's new tool debuts a SaaS approach to help connect and load data from disparate sources without requiring organizations to conduct data transformations. Continue Reading
-
Feature
06 Mar 2020
Pros and cons of the 4 best IPaaS software options
Integrating with your cloud data? Choosing between IPaaS software and vendors can be difficult. Here is a breakdown of four of the top-choice vendor offerings on the market. Continue Reading
-
News
03 Mar 2020
Talend Data Fabric Winter '20 update brings data inventory
Talend's Winter '20 Data Fabric milestone update integrates a new data inventory capability alongside enhanced data pipeline designer capabilities. Continue Reading
-
News
24 Feb 2020
Lessons learned from Credit Karma GraphQL architecture
Credit Karma's vice president of engineering explains why and how the personal finance service is using the GraphQL data query technology to support its growing business. Continue Reading
-
News
19 Feb 2020
Dell EMC Streaming Data Platform integrates open source technology
Dell combines several open source streaming data technologies, including Apache Kafka, Apache Flink and Pravega, to create a new streaming data platform. Continue Reading
-
News
13 Jan 2020
Boomi acquisition of Unifi Software nets data management
Dell Boomi expands its data integration software portfolio by acquiring Unifi Software, providing data preparation and data catalog capabilities. Continue Reading
-
Feature
31 Oct 2019
Data silos and culture lead to data transformation challenges
Data continues to grow at a rapid rate, and users are faced with increasing complexity and challenges to make sense of it all in a way that helps improve business outcomes. Continue Reading
-
News
24 Oct 2019
Splunk advances Data-to-Everything initiative
Splunk execs outline the vendor's direction and new capabilities at its annual user conference, including the general availability of Data Fabric Search and Data Stream Processor. Continue Reading
-
Feature
11 Oct 2019
Data integration vs. ETL in the age of big data
Data integration provides a consistent view of business performance across multiple data sources, though it needs to keep up with the changing needs of organizations and the big data revolution. Continue Reading
-
News
02 Oct 2019
Talend offers automated migration to cloud data warehouse
The new capability is supported by BladeBridge's converter technology and includes self-service tools for data preparation and data integration, among other features. Continue Reading
-
News
19 Sep 2019
Dremio Data Lake Engine 4.0 accelerates query performance
Dremio issues a new platform update, defining itself as data lake engine technology that looks to help users connect and query data faster in AWS and Azure. Continue Reading
-
News
04 Sep 2019
Ascend releases Queryable Dataflows for building data pipelines
Ascend releases a technology preview of a capability that will enable data engineers to directly query dataflows, without the need for data to first be in a data warehouse. Continue Reading
-
News
29 Aug 2019
Align enterprise data architecture, governance for 'quick wins'
Data management consultant Donna Burbank outlines how effective data governance hinges on the deployment of a comprehensive enterprise data architecture. Continue Reading
-
Guide
21 Aug 2019
GDPR, AI intensify privacy and data protection compliance demands
This guide covers the challenges data management teams face on data protection and privacy, particularly with the rise of GDPR and similar laws and the growing use of AI tools. Continue Reading
-
News
21 Aug 2019
SnapLogic boosts its data integration technology with AI
SnapLogic's latest update for its Intelligent Integration Platform aims to make it easier for users to benefit from data integration. Continue Reading
-
Feature
20 Aug 2019
Enterprise data marketplace aims to ease self-service chaos
Self-service data preparation can duplicate work and slow down analytics. One possible fix: an internal marketplace where users can 'shop' for data assets. Continue Reading
-
News
13 Aug 2019
Apollo data graph brings managed federation to enterprises
The new Apollo update is intended to enable organizations to federate multiple enterprise data sets more easily and use APIs to tap into disparate data sources. Continue Reading
-
News
30 Jul 2019
Hitachi Vantara updates Pentaho 8.3 to expand DataOps vision
Hitachi Vantara's new Pentaho update brings DataOps capabilities for data management to help organizations derive better data insights. Continue Reading
-
Feature
24 Jul 2019
Key components of an effective data virtualization architecture
Experts break down which elements -- both technical and nontechnical -- are most crucial to successfully deploying and managing a data virtualization architecture. Continue Reading
-
Feature
19 Jul 2019
11 real-time data streaming roadblocks and how to overcome them
Experts detail common challenges that IT teams encounter when deploying and managing real-time data streaming platforms and offer advice on how to address them. Continue Reading
-
Feature
27 Jun 2019
Explore data integration products for your organization
Browse through the current data integration products currently available to help you determine which tool best suits your organization's needs. Continue Reading
-
Feature
27 Jun 2019
Data modeling techniques to overcome common business challenges
In this interview, author and data modeling instructor Steve Hoberman discusses techniques for dealing with challenges that may arise in the data modeling process. Continue Reading
-
Feature
26 Jun 2019
How 4 organizations are breaking down data silos
Siloed data continues to inhibit enterprise efficiency. Here, IT professionals discuss problems their organizations are facing around data silos -- and how they're solving them. Continue Reading
-
Feature
19 Jun 2019
A comparison of open source, real-time data streaming platforms
With so many real-time data streaming tools, how do you know which is right for your organization? Experts compare Spark Streaming, Kafka Streams, Flink and others. Continue Reading
-
Tip
18 Jun 2019
Data virtualization benefits seen in unified views, IT agility
Through in-place integration, data virtualization platforms can provide wider access to data and simplify security and governance. But they come with some limitations. Continue Reading
-
Feature
14 Jun 2019
Data virtualization use cases cover more integration tasks
In a Q&A, Gartner analyst Mark Beyer discusses user adoption of data virtualization software and the wider data integration uses that the technology is now handling. Continue Reading
-
News
05 Jun 2019
AtScale updates its data warehouse virtualization platform
AtScale 2019.1 comes with many new capabilities, including extended database support, increased security and advanced analytical query capabilities. Continue Reading
-
Feature
10 May 2019
Data virtualization layer feeds logical data warehouse, Agile BI
Indiana University is using data virtualization to combine data from various source systems for analysis, as part of an initiative to improve strategic decision-making. Continue Reading
-
Feature
09 May 2019
Data modeling software tackles glut of new data sources
Data modeling platforms are starting to incorporate features to automate data-handling processes, but IT must still address entity resolution, data normalization and governance. Continue Reading
-
Feature
01 May 2019
Find the best data integration tools for your organization
Read analysis and comparisons of data integration tools to help you select the right platform from the leading commercial and open source products currently on the market. Continue Reading
-
Feature
30 Apr 2019
Data model design tips to help standardize business data
Data models should be understandable to business users and kept to a reasonable scope, say the leaders of a data modeling initiative at England's Environment Agency. Continue Reading
-
Feature
29 Apr 2019
Wayfair charts open source components course to growth
Teams at Wayfair mix new open source tools to power customer-facing apps. In such shops, tech leaders like Ben Clark must deftly maneuver an obstacle course of data components. Continue Reading
-
Feature
03 Apr 2019
Evaluate the features of data integration tools and software
Before you evaluate and select data integration tools and software, assess which must-have, should-have and nice-to-have features match your organization's needs. Continue Reading
-
Feature
02 Apr 2019
Data integration platforms take users beyond ETL software
Discover how commercial data integration platforms help organizations manage and simplify the process of combining and sharing their increasing volumes of data. Continue Reading
-
News
21 Mar 2019
Machine learning approaches gain critical mass for data pros
Machine learning will bring change to analytics and data management, said data luminary Michael Stonebraker. Others agree managing such change will take special effort. Continue Reading