Check System Details# Gather machine configuration information echo "Machine Configuration" echo "----------------------" # Operating System echo "Operating System: $(lsb_release -d | cut -f2-)" # CPU Information echo "CPU: $(lscpu | awk -F: '/Model name/ {print $2}' ...Nov 1, 2023·2 min read
Yet Another Resource Negotiator (YARN )Components of YARN in Cloudera Data PlatformFeb 28, 2023·3 min read
Computer Vision Image Classification with Nifi, CDSW, Kudu, Solr, and HDFSComputer Vision Image Classification with Nifi, CDSW, Kudu, Solr, and HDFS Computer vision applications often involve processing large amounts of image and video data, and require efficient storage, retrieval, and analysis of this data. Image Classif...Feb 7, 2023·2 min read
Log Rotatation in Linuxhousekeeping logs logrotate is a Linux utility that is used to automatically manage and rotate log files. It is used to archive, compress and delete old log files, to keep them from consuming too much disk space. The logrotate utility works by readin...Jan 17, 2023·3 min read
Column-level encoding(s)Column-level encoding is a technique used to compress and optimize data storage in a database. It involves encoding the data in each column of a table separately, rather than encoding the entire table as a whole. This allows for more efficient storag...Jan 13, 2023·5 min read
Range partitioningRange partitioning is a method of dividing a large dataset into smaller, more manageable chunks, based on a range of values. For example, let's say we have a large dataset of customer orders, and we want to partition it based on the date the order wa...Jan 13, 2023·2 min read
Hash partitioningHash partitioning is a method of dividing a large data set into smaller, more manageable partitions. Each partition is assigned a unique "hash key" which is used to determine which partition a particular piece of data belongs to. For example, conside...Jan 13, 2023·1 min read