Hadoop meets Blockchain: Trust your (Big) Data
At a simple level, Blockchains solve a trust problem. Increasingly, companies are relying on third parties to help drive brand recognition and gain consumer trust, this includes trusting third party […]
Log Aggregation, Search, and Alerting on CDH with Pulse
In mid-2017, we were working with one of the world’s largest healthcare companies to put a new data application into production. The customer had grown through acquisition and in order […]
Getting Started with Kudu
Five years ago, enabling Data Science and Advanced Analytics on the Hadoop platform was hard. Organizations required strong Software Engineering capabilities to successfully implement complex Lambda architectures or even simply […]
Data Science Enablement: The First of its Kind
Here at phData we are proud to announce our newest service offering in the Big Data space, Data Science Enablement. phData has driven success in Big Data initiatives for the enterprise […]
Accessing kerberized Sources from Spark2 in Cluster mode on YARN
Introduction Many of phData’s customers face the issue that they need to connect to a source secured via Kerberos in a Spark application. A source can be a JDBC connection […]
Cloudera Altus – First Look
I was lucky enough to attend StrataEU 2017 and one of the sessions was Deploying and managing Hive, Spark, and Impala in the public cloud led by Philip Langdale, Eugene […]
My first year at phData
Last month marked my one year anniversary working at phData, and since a lot of my friends and future applicants have been asking me about my experience so far, I […]
Archiving Navigator Audit Data with StreamSets and Kafka
Andy Stadtler helped with this post Many of phData’s customers are heavy users of Cloudera Navigator. Cloudera Navigator provides metadata information to the user who can also audit all actions […]
Visualizing NetFlow Data with Apache Kudu, Apache Impala (incubating), StreamSets Data Collector, and D3.js
NetFlow is a data format that reflects the IP statistics of all network interfaces interacting with a network router or switch. Netflow records can be generated and collected in near […]
Configuring Oozie for Spark SQL on a Secure Hadoop Cluster
A secure hadoop cluster requires actions in Oozie to be authenticated. However, due to the way that Oozie workflows execute actions, Kerberos credentials are not available to actions launched by […]