Reclaim storage without guessing. Daily, evidence-backed answers to which Hive tables and partitions can be purged on Cloudera CDP — with the coverage proof that makes the answer safe to act on. Expec Reclaim Know what is cold before you delete it. Your cluster already keeps the evidence: who queried what, who opened which file, how large every table and partition is. Expec Reclaim turns that evidence into a daily answer to one question — what hasn't been read, and can it be

Enterprise AI adoption isn't really optional anymore — it's already happening, sanctioned or not. For the people who run Cloudera, Hadoop, Kafka, and the rest of the on-prem or hybrid data stack, that creates a very specific problem: the operational questions they most want to ask an AI assistant are also the ones packed with details they can't afford to leak. AI Isn't a Pilot Program Anymore It's worth pausing on just how fast this shift has happened: Widespread Adoption: In

To address rapidly growing data volumes and an increasing demand for real-time processing, Expec Consulting helped an enterprise organization modernize its data platform by expanding its Hadoop ecosystem and integrating a scalable streaming architecture. By combining distributed storage, real-time streaming, and optimized data access layers, we significantly improved processing capacity, system resilience, and data availability across critical business systems. This transform

As enterprise data volumes continue to grow, traditional batch-oriented data platforms struggle to deliver timely, reliable insights. Manual ETL processes, rigid scheduling, and limited observability often lead to long processing windows and frequent operational failures. To address these challenges, an enterprise organization modernized its data platform by implementing a NiFi-driven On-Premise Data Warehouse (DWH). By placing Apache NiFi at the center of data ingestion, val

Big data platforms play a critical role in enabling organizations to process and analyze massive volumes of information efficiently. As data continues to grow exponentially across operational, analytical, and business domains, maintaining performance, scalability, and reliability becomes a constant challenge. In such an environment, the Cloudera-based big data platform can serve as the backbone for large-scale data ingestion, transformation, and analytics. Leveraging key comp

In today’s digital era, having a secure, scalable, and resilient data infrastructure is critical for driving innovation and informed decision-making. In a recent strategic engagement with a major enterprise, we successfully designed and deployed an enterprise-grade data lake built on Cloudera Data Platform (CDP) transforming their data capabilities from the ground up. High-Level Overview To support rapid business growth and increasingly complex analytics requirements, our cli

In today’s fast-evolving digital landscape, enterprises are under increasing pressure to modernize their data infrastructure. One of the most impactful transformations is the shift from traditional on-premise systems to scalable, cloud-based environments Our company helps organizations seamlessly transition their enterprise data to the cloud, helping reduce complexity, improving scalability, and unlocking the full potential of modern data platforms. Through careful planning,

In today’s data-driven environment, effective log management is essential for optimizing system performance, enhancing security, and ensuring business continuity. Our Log Management System (LMS) offers a comprehensive solution for managing and analyzing log data from various sources, enabling organizations to track activities, generate insights, and automate alerts to maintain a seamless operational flow. High-Level Overview The Log Management System (LMS) is designed to cent

Security is an important facet in today's Business environment, without the correct implementation it will expose business to significant risks such as data breaches, financial losses, reputational damage, and legal liabilities. One of our experience working in Hadoop Environment with Hive UDF / Impala UDF, we've implemented an extra layer of security to help with the encryption / decryption process of data in Hadoop In this use case we've created a service to help with the e

In Apache NiFi, flowfiles are the fundamental data structures that carry data through the system. While flowfiles have content, they also have attribute (metadata that describes the content). Sometimes, it’s useful to convert specific pieces of content into attributes for easier processing and routing. This article will guide you through this process. Step-by-step process : Generate CSV Data Convert CSV to JSON Split Data Extract Content (JSON) to Attributes Set Up The Flow i

Apache NiFi is a powerful data integration tool that allows you to automate the flow of data between systems. Two useful features for enriching data in NiFi are Join Enrichment and Fork Enrichment. In this post, we’ll explain how to use these features, along with sample data and step-by-step instructions. Fork Enrichment: Fork Enrichment is used when you want to enrich data by splitting it into multiple streams and performing operations on each stream separately. Nifi docs: F

Recently, we came across a customer who wanted to setup a kerberized cluster but they do not have an active directory server in their infrastructure. Therefore, we needed to find a solution for LDAP + Kerberos cluster. After many trials, research and time constraint, we decided to use freeipa solution to provide LDAP + Kerberos server. We are glad with our choice since freeipa actually provides much more than we wish for. Versions: Cloudera Manager: 6.3 CDH: 6.2.1 IPA : 4.6.

I would like to share my experience configuring Hue with Oracle RAC. Last year I came across a client who uses Oracle RAC Database as the CDH metadata. During the initial setup, you are asked to enter database information like below: In this page, we would normally enter the following info Hostname : <Oracle RAC Scan IP> Database Type: Oracle Database Name: <Service Name> Username: <username> Password: <password> Everything test successfully EXCEPT for HUE. Hue will not be ab

Recently my client ask me, how can I find the real user who execute a job using hive? When executing a job via hive, if we check the job status in YARN, the job will be executed using hive user when user impersonation is active. This is not very useful when we want to know the owner of the query. After some digging, I found out how to find the actual user. Below are the steps to find out the actual user. It may vary a bit depending on the job status, whether it is currently

The purpose of this article is to document my observation of HDFS Balancer behavior during my work engagement. It is also possible this observation is valid only for certain version. These observation applies to CDH 5.11+, although I noticed that each CDH minor release there are new parameter introduced to optimize the balancer. A few general tips I recommends: Search the web, there are many great article out there Make sure to check version compatibility Test and validate

Cloudera provides a scalable, flexible, integrated platform that makes it easy to manage rapidly increasing volume and varieties of data in your enterprise. Cloudera products and solutions enable you to deploy and manage Apache Hadoop and related projects, manipulate and analyze your data, and keep that data secure and protected. CDH is the most complete, tested, and popular distribution of Apache Hadoop and related projects. CDH delivers the core element of Hadoop - scalable

Nowdays the development of multiplatform application by using a framework become an alternative for developer, besides can save production cost, developer only need to do one-time coding and then mobile application can be used on various platform neither Android or iOS. One of the frameworks that can be used to build a mobile application is called React Native. What is React Native? React Native is a framework made by Facebook that can be used to develop native applications

This is going to be a series of blog post sharing our experience creating a production mobile app with React Native. In this blog, we would like to share a bit about our background and how we come to use React Native. Let me start with a little background about our team. We are a team of system integrators and we develop backend stuffs. It’s our bread and butter. We implement Oracle Fusion Middleware solution such as Oracle SOA Suite, Oracle Service Bus, Oracle Business

"Is it scalable? Is it High Performance? What about High Availability?" Those are the questions, we frequently encounter from our clients. We at EXPECC has deployed many WebLogic Server, the most reliable and fastest application server on the market, to many mission critical applicaiton in Financial Service Industry and Telecommunication Industry. In each deployment we ensure the configuration followed Oracle Best Practises for Reliability, Availability, Scalability and Hig

Data is a crucial part for Business and Corporation. Customer data, Vendor data, Product data, and many other data are very important to secure and always available when required. We at EXPECC partnered with Oracle has implemented data replication solutionn in helping our clients businesses keep up with the competition. We realize that data replication can be complex and we can to simplify. Replication Strategy Data is everywhere. In most cases, enterprise required to rep