Any word on Cassandra storage backend? - Google Groups



Any word on Cassandra storage backend? - Google Groups

Debugging the PIO Framework is different than the Templates. If you are primarily working on a Cassandra version of the backend you may not need a template until you want to test reading and there are ways to see what is in the EventServer (read) without a template.

I have done template dev and never have to build from the CLI except when the config engine.json changes. IDEA does the incremental compile when code changes.

That said, using IDEA on the Framework is new to me but I'm planning some PRs to do with the storage API soon and will require getting IDEA setup. 

1) the PIO sbt is really only required for the install script for the first time, thereafter you can use your own installation of sbt.
2) let's try it and solve problems as they some up. Seems like most PIO folks don't use a debugger as a matter of preference. Judging from template debugging, it may take some work but all things are possible :-) To try out a new backing store it may be you only need to mess with the EventServer by building and restarting. The CLI for starting the EventServer can be mimicked with a debug config in IDEA. Once set up the incremental compile will be triggered automatically. We should get some guidance from others here.
3) Speaking for myself unit tests are great if they can be done at compile time and don't require a running system, which is where scripted integration tests come in.

Using Hbase as a starting point is ok if you are alright with requiring Elasticsearch for PIO "metadata". The massively scalable architecture for PIO uses HBase + ES. Other templates run fine with a single store for metadata and event data. If you want a single backing store for metadata and events you may want to look at the JDBC backend since it does both. Cassandra should be able handle both and scale indefinitely.

Read full article from Any word on Cassandra storage backend? - Google Groups


No comments:

Post a Comment

Labels

Algorithm (219) Lucene (130) LeetCode (97) Database (36) Data Structure (33) text mining (28) Solr (27) java (27) Mathematical Algorithm (26) Difficult Algorithm (25) Logic Thinking (23) Puzzles (23) Bit Algorithms (22) Math (21) List (20) Dynamic Programming (19) Linux (19) Tree (18) Machine Learning (15) EPI (11) Queue (11) Smart Algorithm (11) Operating System (9) Java Basic (8) Recursive Algorithm (8) Stack (8) Eclipse (7) Scala (7) Tika (7) J2EE (6) Monitoring (6) Trie (6) Concurrency (5) Geometry Algorithm (5) Greedy Algorithm (5) Mahout (5) MySQL (5) xpost (5) C (4) Interview (4) Vi (4) regular expression (4) to-do (4) C++ (3) Chrome (3) Divide and Conquer (3) Graph Algorithm (3) Permutation (3) Powershell (3) Random (3) Segment Tree (3) UIMA (3) Union-Find (3) Video (3) Virtualization (3) Windows (3) XML (3) Advanced Data Structure (2) Android (2) Bash (2) Classic Algorithm (2) Debugging (2) Design Pattern (2) Google (2) Hadoop (2) Java Collections (2) Markov Chains (2) Probabilities (2) Shell (2) Site (2) Web Development (2) Workplace (2) angularjs (2) .Net (1) Amazon Interview (1) Android Studio (1) Array (1) Boilerpipe (1) Book Notes (1) ChromeOS (1) Chromebook (1) Codility (1) Desgin (1) Design (1) Divide and Conqure (1) GAE (1) Google Interview (1) Great Stuff (1) Hash (1) High Tech Companies (1) Improving (1) LifeTips (1) Maven (1) Network (1) Performance (1) Programming (1) Resources (1) Sampling (1) Sed (1) Smart Thinking (1) Sort (1) Spark (1) Stanford NLP (1) System Design (1) Trove (1) VIP (1) tools (1)

Popular Posts