Getting Into The Cloud With CDH In Minutes
A few weeks ago we wrote an article on the pros and cons of running your Hadoop capabilities in the Cloud compared to on-premise. The conclusion was that there isn’t […]
Example Self Contained Spark Application
For the past few weeks we’ve showed some simple examples on how to use Hive and Impala with different file formats along with partitioning. These approaches have exercised two very […]
Hands On Example With Hive Partitioning
Building off our Simple Examples Series, we wanted to take five minutes and show you how to recognize the power of partitioning. For a more detailed article on partitioning, Cloudera […]
Binary Stream Ingest: Flume vs Kafka vs Kinesis
Introduction The internet of things will put new demands on Hadoop ingest methods, specifically in its ability to capture raw sensor data — binary streams. As discussed, big data will […]
Examples Using AVRO and ORC with Hive and Impala
Building off our first post on TEXTFILE and PARQUET, we decided to show examples with AVRO and ORC. AVRO is a row oriented format, while Optimized Row Columnar (ORC) is […]
Build a Hadoop Distribution like Hortonworks or Cloudera
Apache Hadoop and much of it’s ecosystem are free and open source. Due to it’s free nature, customers often ask, why would I need a distribution such as Cloudera, Hortonworks, […]
Examples Using TEXTFILE and PARQUET with Hive and Impala
phData is a fan of simple examples. With that mind set, here is a very quick way for you to get some hands on experience seeing the differences between TEXTFILE […]
Hadoop Versions In Vendor Distributions
Hadoop distributions typically come with between 20-30 open source projects, all bundled together to make a “big data platform” enterprises can deploy and maintain in a sustained manor. E.g. Hadoop […]
4 Strategies for Updating Hive Tables
Apache Hive and complementary technologies such as Cloudera Impala provide scalable SQL on Apache Hadoop. Unlike legacy database systems Hive and Impala have traditionally not provided any update functionality. However, many […]
The Paradox of Agile Data Management
At phData, many of us come from a software development background and have witnessed the success of Agile Methodologies. Agile started in software development where it quickly gained popularity, but […]