Author: Yanick Champoux

As mentioned in my past adventures, I’m often working with the workflow management tool ominously called Azkaban. Its foreboding name is not really deserved; it’s relatively straightforward to use, and offers a fairly decent workflow visualization. For that last part,…

As you might already know, I come up with my fair share of toy web applications. Once created, I typically throw them on my server for a few weeks but, as the resources of good ol’ Gilgamesh are limited, they…

Not so long ago, I was playing with ElasticSearch, which has the interesting characteristic of having a REST API as its primary interface. Sure, it’s a little more stilted and awkward than any native interface but, on the other hand,…

Last week, I finally got around writing a few macros to help with conflict resolution in Vim: ” conflict resolution – pick this one / option 1 / option 2 map ,. $?\v^[<=]{7}jy/\v^[=>]{7}?\v^[<]{7}”_d/\v^\>{7}”_ddP map ,< $?\v^[<]{7}<,>. map ,> $?\v^[<]{7}/\v^[=]{7}<,>. “…

Today we’re having a quick one. Earlier during the day, I had to peruse an Oozie log for the first time. And it looked like: 2014-02-11 20:13:14,211 INFO ActionStartXCommand:539 – USER[running_user] GROUP[-] TOKEN[] APP[some-big-job-workflow] JOB[0004636-140111040403753-oozie-W] ACTION[[email protected]:start:] Start action [[email protected]:start:] with…

Sometimes, you idly think about a problem, and an answer comes to you. And it has the simplicity and the elegance of a shodo brush-stroke. It is so exquisitely perfect, you have to wonder… Have you reached the next level…

Statistics and graphs — they don’t always mean much, but they can be so darn mesmerizing. It’s in that optic that I was looking at the Map of CPAN the other day and thought, “Wouldn’t it be cool to have…

Shortly before the Holidays, I became aware of the Dallas/Fort Worth Perl Mongers Winter Hackaton Contest. The challenge was simple enough: Here’s a directory structure filled with 100G worth of files, go and find all the duplicate files in there,…

First things first: Happy New Year y’all! Health, happiness, and all that jazz to each and everyone of youses! So the Holidays are over — or almost over, if you are one of the few lucky souls. Which means that…

Recently, I’ve been playing with the workflow managers of the Hadoop world. Namely, Azkaban and Oozie. While Azkaban offers a cute graph-oriented display of your running workflows, it is a little bit limited in the workflow logic department. No conditional…