Big data application development: An introduction to Hadoop

Big data application development

The complexity of big data application development and deployment is opening doors for channel partners that can help make their customers' projects successful. The task requires more than finding powerful hardware and software. Companies want to mine their information -- use it competitively after they collect it. This area presents opportunities and challenges to resellers and their customers.

Traditional database management systems (DBMSs) do not easily scale to support very large data sets.

With big data, application development and deployment demand a lot of custom integration work. An organization needs to pull information from a variety of sources. With the number of sources and formats rising, such work has become complex and time-consuming.

Then, the organization must present the data to employees in a manner that lets them slice and dice it. Unlike traditional systems that focus on automating routine tasks and reducing headcount, big data provides more nebulous business insights, such as how to improve sales.

"Businesses collect a lot of information but have trouble tapping into it in a way that provides them with ways to improve the organization," said John Bender, senior vice president and general manager at RCG Global Services, an IT consulting firm with more than 1,000 employees and a partnership with MapR Technologies.

Sometimes, a business goes down a few unproductive paths. Rather than a grandiose initial application, "organizations should start small with a system where they already have data and an understanding of a business problem," stated Paul Bachteal, senior director of global sales support at SAS Institute Inc., which has been working with the Hortonworks' Hadoop distribution since 2013.

Reseller programs take shape

As the market has matured, the leading suppliers have built up their reseller programs to aid companies exploiting big data technology. The MapR Converge Partners program was launched in June 2016 and includes three levels of partners. An Affiliate designation enables resellers to begin working with MapR. In the Preferred level, resellers have regional practices and mature value-added offerings. The Elite grouping features resellers that have a significant presence in multiple geographies; these channel partners are assigned an account manager.

In July 2017, MapR added the Elite Premier partner category to its top tier. This program level includes executive sponsorships for joint business alignments; designated alliance managers; direct engagement with the MapR professional services team; access to customized partner training, and investments in joint marketing and sales programs.

The Hortonworks Partnerworks program, meanwhile, focuses on two reseller relationships. The Managed Service Provider certification provides a support-focused approach for companies delivering managed services that include Hortonworks products. The Modern Data Solutions level is designed for partners that have certified integrations with Hortonworks solutions.

At Cloudera, the company's channel program features a half-dozen partner types: technology providers (independent software vendors and independent hardware vendors), service providers, authorized resellers, OEMs, cloud partners, and training providers. The vendor has focused on providing training for IT professionals and developed nine courses based on various Hadoop skills. Since 2009, 40,000 individuals have completed Cloudera's certifications in areas such as Designing and Building Big Data Applications and Cloudera Search Training.