Streaming Probabilistic Algos

• Twitter's Algebird
• Redis HyperLogLog
• Redshift HyperLogLog(http://docs.aws.amazon.com/redshift/latest/dg/r_COUNT.html)

Probabilistic Algorithm Examples

Bloom Filter Set.contains()

• Zeppelin Notebook Code

http://<your-cloud-ip>:3123/#/notebook/2B89S6BYQ

HyperLogLog Count Distinct

• Zeppelin Notebook Code

http://<your-cloud-ip>:3123/#/notebook/2B8YJZJB1

CountMin Sketch TopK

• Zeppelin Notebook Code

http://<your-cloud-ip>:3123/#/notebook/2B7S5BZQV

Spark Streaming + Probabilistic Algorithm Examples

Spark Streaming + Algebird's HyperLogLog Count Distinct

• Spark Streaming Code
• Spark Streaming Start Script

Spark Streaming + Algebird's CountMin Sketch TopK

• Spark Streaming Code
• Spark Streaming Start Script

Spark Streaming + Redis HyperLogLog

• Spark Streaming Code
• Spark Streaming Start Script