Q: What benefits and pitfalls have you found with your use of NoSQL in the cloud?
Based on having used Amazon's SimpleDB service over the past 18 months.
Benefits: pay as go is great for starting off, zero maintenance, zero setup, scaling by spreading data across multiple domains, SimpleSB manages data replication and high availability
Pitfalls: new mindset required to use eventually consistent model, increase impact of network latency, keeping SimpleDB's limitations in mind (size of domains, attribute count, etc.)
Q: How viable are these solutions and what is hampering there adoption?
Viability: SimpleDB has a 2 year track record and recently added consistent reads and conditional puts/deletes opening up new classes of application possibilities.
Adoption: Need body of knowledge, best practice patterns and use cases are still emerging
Defines NoSQL as: No joins and light transaction semantics
Makes scaling horizontally easier
Key questions that all NoSQL products need to answer are what are the differences and what kind of consistency model is being used
* Crossroads, Inroads, Pitfalls Bylaws: Peering into NoSQL's Conceivable Future (Tim Anglade)
Database market is big, clearly room for NoSQL
Crossroads: just moving out of the startup only world but the focus is still on early adopters, NoSQL hype is about to peak, most NoSQL projects are at various states of usefulness.
Inroads: Still need to make the technology better, need better marketing of the NoSQL brand, must focus on education, for many database = SQL
Pitfalls: education disrupts current RDBMS market so existing companies will fight back, overlooking the need for education
Bylaws: For some industries innovation is a liability, junior developers trying to work without training very hard
When NoSQL reaches the point that its search term frequency doesn't drop off during the December holiday season, then we know its gotten into the corporate world.
How to fix things: make inroads in education, create a NoSQL book of knowledge, form an interest group to act as a liaison to the world, host two annual conferences start with US/EU.
* Scaling with NoSQL (Bradford Stephens moderator, Mark Atwood, Doug Judd, Alex Feinberg, Ryan Rawson, Ryan King)
Myth that NoSQL maintenance is easier. NoSQL usually has more operational overhead due to the intersystem dependencies for horizontal scaling. Failure modes require less scrambling, no need to wake up at 2am if a node fails.
Hadoop is hard to get up and running.
Murder is a BitTorrent based software deployment package.
Most of these NoSQL solutions have issues with more data than RAM.
Testing NoSQL scaling really needs at least 5-10 nodes before things get interesting.
HBase and others don't handle random reads well due to underlying HDFS usage.
NoSQL scaling bound by CAP Theorem
memcached suffers from lack of dynamic scaling
cassandra rebalancing has issues with hot spotting
hypertable uses masters with hot standby to avoid SPoF
* Full Stack JavaScript (Jim Wilson)
Run JavaScript from top to bottom to avoid language impedance mismatches.
JavaScript on the server solutions: node.js, narwhal, rhino
* Schema Design with Document-Oriented Databases (Durran Jordan moderator, Eliot Horowitz, Bryan Fink, Paul Davis)
Many to Many is hard
Solutions make use of soft links for following data to allow sharding
* The Evolution of the Graph Data Structure from Research to Production (Marko Rodriguez moderator, Peter Neubauer, Borislav Iordanov, Sandro Hawke)
Graph database are geared towards modeling relationships. Think of it as the graph is the index.
HyperGraph concept isn't that popular but offers multiple edge connections.
Neo4J property graph with directed edges and key/value on edges and nodes. Think of it as a multi-dimensional linked list with full ACID support and fast path traversal. Working to ad replication, removing SPoF, better scaling.
RDF is like JSON but with loops. RDF Schema or OWL add constraints. Most RDF implementations are not designed for performance but complex pattern matching. ELMO has JavaBean to RDF mapping. SPARQL standard for querying RDF.
Gremlin is a graph database programming language.
* Toward Web Standards for NoSQL (Sandro Hawke)
XML is on the way out (but it will never die)
JSON became IETF standard
Standard bodies are not always needed, look at popular open source programming languages, they are creating there own standards that everyone can contribute due to its openness.
Hard to do that for some segments, there won't be only one open source web browser, so that is where standards bodies help.
* NoSQL Lab
]]>[org.apache.commons.httpclient.HttpMethodDirector] -
Turns out the process had been running long enough that while trying to perform an HTTPS based operation the certificate in the JVM for the certificate authority the target site was using had expired. A quick update of the cacerts file and everything was happy again. Yet another software rot angle to keep in mind.
]]>
Us: Americans Talk About Love by John Bowe
A Fire Upon The Deep by Vernor VingeYou do one thing at a time.
I've been casting my net wide these past fews months and so far haven't found that one thing yet, but I know when I do it will ring true like is has in the past.
]]>
Don't Make Me Think: A Common Sense Approach to Web Usability by Steve Krug
The Music of Chance by Paul Auster
My rating: 2 of 5 stars
The book started off great. I had visions of Rounders and Good Will Hunting in my head as the story started to unfold. Unfortunately once they lost the big poker game and voluntarily entered indentured servitude my suspension of disbelief was broken and I could no longer relate to the characters. As a result I found it a drudgery to complete the book.
// _mxmlc, _cssFile, _brandFile, and _kitDir are of type File var nativeProcessStartupInfo:NativeProcessStartupInfo = new NativeProcessStartupInfo(); nativeProcessStartupInfo.executable = _mxmlc; var mxmlcArguments:Vector.<String> = new Vector.<String>(); mxmlcArguments.push(_cssFile.nativePath); mxmlcArguments.push("-output"); mxmlcArguments.push(_brandFile.nativePath); nativeProcessStartupInfo.arguments = mxmlcArguments; nativeProcessStartupInfo.workingDirectory = _kitDir;
Create and attach listeners to a Native Process:
// _nativeProcess is of type NativeProcess _nativeProcess = new NativeProcess(); _nativeProcess.addEventListener(Event.STANDARD_ERROR_CLOSE, handleStandardErrorClose); _nativeProcess.addEventListener(Event.STANDARD_INPUT_CLOSE, handleStandardInputClose); _nativeProcess.addEventListener(Event.STANDARD_OUTPUT_CLOSE, handleStandardOutputClose); _nativeProcess.addEventListener(IOErrorEvent.STANDARD_ERROR_IO_ERROR, handleStandardErrorError); _nativeProcess.addEventListener(IOErrorEvent.STANDARD_INPUT_IO_ERROR, handleStandardInputError); _nativeProcess.addEventListener(IOErrorEvent.STANDARD_OUTPUT_IO_ERROR, handleStandardOutputError); _nativeProcess.addEventListener(ProgressEvent.STANDARD_ERROR_DATA, handleStandardErrorData); _nativeProcess.addEventListener(ProgressEvent.STANDARD_INPUT_PROGRESS, handleStandardInputProgress); _nativeProcess.addEventListener(ProgressEvent.STANDARD_OUTPUT_DATA, handleStandardOutputData); _nativeProcess.addEventListener(NativeProcessExitEvent.EXIT, handleNativeProcessExit);
Typical event handling code:
private function handleStandardOutputData(progressEvent:ProgressEvent):void { trace(_nativeProcess.standardOutput.readUTFBytes(_nativeProcess.standardOutput.bytesAvailable)); } private function handleNativeProcessExit(nativeProcessExitEvent:NativeProcessExitEvent):void { trace(nativeProcessExitEvent.exitCode); }
Create a new server socket that listens on an OS selected available port:
// _serverSocket is of type ServerSocket _serverSocket = new ServerSocket(); _serverSocket.addEventListener(Event.CLOSE, handleServerClose); _serverSocket.addEventListener(Event.CONNECT, handleServerConnect); _serverSocket.bind(); _serverSocket.listen();
Handle a new incoming connection:
private function handleServerConnect(serverSocketConnectEvent:ServerSocketConnectEvent):void { var socket:Socket = serverSocketConnectEvent.socket; socket.addEventListener(ProgressEvent.SOCKET_DATA, handleSocketData); socket.addEventListener(Event.CLOSE, handleSocketClose); socket.addEventListener(IOErrorEvent.IO_ERROR, handleSocketIOError); }
Handling socket data:
private function handleSocketData(progressEvent:ProgressEvent):void { var socket:Socket = Socket(progressEvent.target); var byteArray:ByteArray = new ByteArray(); socket.readBytes(byteArray, 0, socket.bytesAvailable); socket.writeUTFBytes("HTTP/1.1 404 Not Found" + CRLF); socket.writeUTFBytes("Connection: close" + CRLF); socket.writeUTFBytes(CRLF); socket.flush(); socket.close(); }]]>
| Count | Subject |
|---|---|
| 396 | [no subject] |
| 127 | free cialis |
| 124 | age is no longer a barrier for me in bed |
| 123 | pay shipping and get your trials |
| 119 | le_vrai_jeu_se_joue_seulement_lm-`_om-y_il_a_commencm-i:_m-`_las_vegas!_ |
| 115 | we know you want the free cialis |
| 115 | pay shipping for your erotic nights |
| 115 | don't pay anything for your pills for 15 days |
| 114 | feel 10 years younger in bed today |
| 114 | do not underestimate the value of free pills |
| Count | Word |
|---|---|
| 8854 | your |
| 6988 | for |
| 6031 | free |
| 5426 | the |
| 4851 | to |
| 4666 | a |
| 4600 | you |
| 3587 | and |
| 3504 | get |
| 3014 | in |
]]>