In today’s digital era, having a secure, scalable, and resilient data infrastructure is critical for driving innovation and informed decision-making. In a recent strategic engagement with a major enterprise, we successfully designed and deployed an enterprise-grade data lake built on Cloudera Data Platform (CDP) transforming their data capabilities from the ground up. High-Level Overview To support rapid business growth and increasingly complex analytics requirements, our cli

In today’s fast-evolving digital landscape, enterprises are under increasing pressure to modernize their data infrastructure. One of the most impactful transformations is the shift from traditional on-premise systems to scalable, cloud-based environments Our company helps organizations seamlessly transition their enterprise data to the cloud, helping reduce complexity, improving scalability, and unlocking the full potential of modern data platforms. Through careful planning,

Security is an important facet in today's Business environment, without the correct implementation it will expose business to significant risks such as data breaches, financial losses, reputational damage, and legal liabilities. One of our experience working in Hadoop Environment with Hive UDF / Impala UDF, we've implemented an extra layer of security to help with the encryption / decryption process of data in Hadoop In this use case we've created a service to help with the e

I would like to share my experience configuring Hue with Oracle RAC. Last year I came across a client who uses Oracle RAC Database as the CDH metadata. During the initial setup, you are asked to enter database information like below: In this page, we would normally enter the following info Hostname : <Oracle RAC Scan IP> Database Type: Oracle Database Name: <Service Name> Username: <username> Password: <password> Everything test successfully EXCEPT for HUE. Hue will not be ab

Recently my client ask me, how can I find the real user who execute a job using hive? When executing a job via hive, if we check the job status in YARN, the job will be executed using hive user when user impersonation is active. This is not very useful when we want to know the owner of the query. After some digging, I found out how to find the actual user. Below are the steps to find out the actual user. It may vary a bit depending on the job status, whether it is currently

The purpose of this article is to document my observation of HDFS Balancer behavior during my work engagement. It is also possible this observation is valid only for certain version. These observation applies to CDH 5.11+, although I noticed that each CDH minor release there are new parameter introduced to optimize the balancer. A few general tips I recommends: Search the web, there are many great article out there Make sure to check version compatibility Test and validate

Cloudera provides a scalable, flexible, integrated platform that makes it easy to manage rapidly increasing volume and varieties of data in your enterprise. Cloudera products and solutions enable you to deploy and manage Apache Hadoop and related projects, manipulate and analyze your data, and keep that data secure and protected. CDH is the most complete, tested, and popular distribution of Apache Hadoop and related projects. CDH delivers the core element of Hadoop - scalable