Teradata has announced a new “design pattern” approach for data lake deployment which leverages years of experience in big data consulting and optimization to help clients build and benefit from data lakes. The new design pattern approach is an industry first and positions Teradata at the forefront in helping business users, data scientists and IT professionals establish data lakes that produce exceptional business value.
Organizations are exploring the functionality of data lakes to create insight and opportunity from exploding data volumes, yet serious problems entangle their IT teams, including a lack of best practices, the shortage of data scientists, and even confusion regarding the definition of a data lake. In addition to these challenges, technology choices are multiplying. For example, data lakes are typically assumed synonymous with Hadoop – which is an excellent choice for many data lake workloads – however, a data lake can be built on multiple technologies such as Hadoop, NoSQL, Amazon Simple Storage Service (S3), a relational database (RDBMS), or various combinations thereof. And while technologies are critical to the outcome, a successful data lake needs a plan. A data lake design pattern is that plan. The design pattern consists of intellectual property based on enterprise-class best practices combined with products co-developed from a stream of successful customer engagements.
“In today’s competitive environment, data lakes can provide practical benefits to Indian companies who are increasingly adopting big data analytics. Data lake design pattern is the way forward today and Teradata’s expertise will help in providing great value to businesses while simplifying business infrastructure,” said Mr. Sunil Jose, Managing Director, Teradata India
“Teradata has moved ahead of the curve in defining implementation patterns for data lakes,” said Tony Baer, Senior Analyst, OVUM. “A data lake is different from an operational data store. Teradata’s value proposition stems from practical, on-the-ground experience helping customers cope with managing data in heterogeneous environments. With the acquisition of Think Big, Teradata has added valuable IP — design patterns that will help build transparent data lakes.”
By having access to new data such as customer service records, clickstream data, IP traffic, log information, and sensor data stored in a data lake, users can address cases that generally require multiple, simultaneous interpretations of the data to be tested against each other.
Teradata also offers a variety of products and technologies enhanced for use with data lake environments. These include Teradata Listener, which simplifies streaming big data into the data lake with an intelligent, self-service software solution; Teradata Appliance for Hadoop, the low cost choice for storing data; Presto, which provides a modern SQL-on-Hadoop architecture; and data lake accelerators built from IP, referred to as Pipeline Controller and Buffer Server, which together orchestrate data movement efficiently from local servers into Hadoop.
