Understanding YARN’s Resource Manager: Scheduling Policies at Scale
As of June 22, 2016, Apache Hadoop YARN (Yet Another Resource Negotiator) continues to power many of the world’s largest data platforms. At the heart of YARN...
Recent Posts
Kafka and Zero-Copy: High-Throughput Messaging via Linux Kernel Optimizations
As of June 18, 2016, Apache Kafka continues to dominate the world of high-throughput messaging systems. One of the lesser-known but critical features contrib...
Logistic Regression with SparkML: Practical Classification in Scala
It’s June 2016, and logistic regression remains one of the most reliable, interpretable models for binary classification problems. With SparkML and Scala, it...
Linear Regression: Elegant Simplicity for Real-World Problems
It’s June 2016, and while machine learning continues to evolve with deep neural nets and complex ensemble methods, linear regression remains one of the most ...
Efficient Offset Management in Kafka Using HBase
Kafka is a well-established as a backbone for real-time data pipelines. But as usage scaled and teams built increasingly distributed consumer groups, a key c...