Composability through Homomorphism: Writing Better Spark DataFrames in Scala
In December 2015, as Spark 1.6 was gaining traction across the data world, one of its most powerful ideas was hiding in plain sight: homomorphism.
Recent Posts
Understanding Homomorphic Types in Haskell: Practical Abstractions from Deep Theory
In the world of Haskell — and functional programming more broadly — you’ll often hear terms like functor, monoid, and homomorphism.
Infinite Data Structures and Transcendental Thinking in Haskell
In the landscape of programming languages in 2015, Haskell continues to quietly demonstrate how radical ideas like infinite data structures, tail recursion, ...
Apache Hive, Predicate Pushdown, and the Challenge of Small Files at Petabyte Scale
By October 2015, Apache Hive had firmly established itself as the SQL engine of choice in the Hadoop ecosystem — powering data warehouse-style workloads at s...
Apache Hive in 2015: SQL at Scale, Predicate Pushdown, and the Evolution of Big Data Warehousing
By October 2015, Apache Hive had matured from a batch-oriented MapReduce abstraction to a fully capable, distributed SQL engine for big data warehousing.