This sounds amazing. I've done iterative jobs in hadoop before - it's very hacky and I generally just have it launch job after job after job until the result converges to where I want it. I'll definitely try this out soon.
Then again, while I absolutely love doing work with big data, I've been having a bit of an "existential crisis" since the NSA leaks :(
Then again, while I absolutely love doing work with big data, I've been having a bit of an "existential crisis" since the NSA leaks :(