PRO+ Premium Content/Modern Stack
Access your Pro+ Content below.
Big data processing could be the way all data is processed
This article is part of the Modern Stack issue of August 2018, Vol. 1, No. 3
Have you noticed yet? Those geeky big data platforms based on clusters of commodity nodes running open source parallel processing algorithms are evolving into some seriously advanced IT functionality. The popular branded distributions of the Apache projects, including Hortonworks, Cloudera and MapR, are no longer simply made up of relatively basic big data batch query tools, such as Hadoop MapReduce, the way they were 10 years ago. We've seen advances in machine learning, SQL-based transaction support, in-memory acceleration, interactive query performance, streaming data handling, enterprise IT data governance, protection and security. And even container services, scheduling and management are on a new level. Big data platforms now present a compelling vision for the future of perhaps all IT data processing. Wait, do I really mean all IT data center processing will be big data processing? Most of us are just getting used to the idea of investing in and building out functional data lakes to capture and collect tons of ...
Features in this issue
-
Microservices development will fail with monolithic mindset
Enterprises that build microservices with traditional development tools and practices can run into problems in configuration and dependency management.
-
Most jobs in the IT industry pay well, but skills matter
A survey of tech professionals identified which IT skills are most in demand. Find out how salaries compare from region to region, and how expertise affects compensation.
Columns in this issue
-
The enterprise will kill cloud innovation -- but that's OK
Hyperscale cloud providers grew incredibly fast and created a whole new way of doing business. That's great, but it's also a problem that needs fixing.
-
Emotional intelligence in the workplace makes a difference
Technologists need to know people as well as they know their craft. Applying emotional intelligence in the workplace helps convey ideas and change organizations.