fullstackpython.github.com/no-sql-datastore.html at gh-pages · aoracle/fullstackpython.github.com · GitHub

History

539 lines (532 loc) · 26.9 KB

Raw

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

333

334

335

336

337

338

339

340

341

342

343

344

345

346

347

348

349

350

351

352

353

354

355

356

357

358

359

360

361

362

363

364

365

366

367

368

369

370

371

372

373

374

375

376

377

378

379

380

381

382

383

384

385

386

387

388

389

390

391

392

393

394

395

396

397

398

399

400

401

402

403

404

405

406

407

408

409

410

411

412

413

414

415

416

417

418

419

420

421

422

423

424

425

426

427

428

429

430

431

432

433

434

435

436

437

438

439

440

441

442

443

444

445

446

447

448

449

450

451

452

453

454

455

456

457

458

459

460

461

462

463

464

465

466

467

468

469

470

471

472

473

474

475

476

477

478

479

480

481

482

483

484

485

486

487

488

489

490

491

492

493

494

495

496

497

498

499

500

501

502

503

504

505

506

507

508

509

510

511

512

513

514

515

516

517

518

519

520

521

522

523

524

525

526

527

528

529

530

531

532

533

534

535

536

537

538

539

<!DOCTYPE html>

<title>NoSQL Data Stores - Full Stack Python</title>

<!--[if lt IE 9]>

<![endif]-->

var _gaq = _gaq || [];

_gaq.push(['_setAccount', 'UA-19910497-7']);

_gaq.push(['_trackPageview']);

(function() {

var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;

ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';

var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);

})();

</script> </head>

<body>

</a>

<span class="logo-title"><a href="/">Full Stack Python</a></span>

</div>

</div> <div class="row">

<h1>NoSQL Data Stores</h1>

<p>Relational databases store the vast majority of web application

persistent data. However, there are several alternative classifications of

storage representations.</p>

<ol>

<li>Key-value pair</li>

<li>Document-oriented</li>

<li>Column-family table</li>

<li>Graph</li>

</ol>

<p>These persistent data storage representations are commonly used to augment,

rather than completely replace, relational databases. The underlying

persistence type used by the NoSQL database often gives it different

performance characteristics than a relational database, with better results

on some types of read/writes and worse performance on others.</p>

<h2>Key-value Pair</h2>

<p>Key-value pair data stores are based

on <a href="http://en.wikipedia.org/wiki/Hash_table">hash map</a> data structures.</p>

<h3>Key-value pair data stores</h3>

<ul>

<li><a href="http://redis.io/">Redis</a> is an open source in-memory key-value pair data

store. Redis is often called "the Swiss Army Knife of web application

development." It can be used for caching, queuing, and storing session data

for faster access than a traditional relational database, among many other

use cases. <a href="https://github.com/andymccurdy/redis-py">Redis-py</a> is a solid

Python client to use with Redis.</li>

</ul>

<h3>Key-value pair resources</h3>

<ul>

<li>

<p>"<a href="https://www.digitalocean.com/community/tutorials/how-to-install-and-use-redis">How To Install and Use Redis</a>"

is a guide for getting up with the extremely useful in-memory data store.</p>

</li>

<li>

<p>This video on

<a href="https://www.youtube.com/watch?v=rP9EKvWt0zo">Scaling Redis at Twitter</a> is

a detailed look behind the scenes with a massive Redis deployment.</p>

</li>

</ul>

<h2>Document-oriented</h2>

<p>A document-oriented database provides a semi-structured representation for

nested data. </p>

<h3>Document-oriented data stores</h3>

<ul>

<li>

<p><a href="http://www.mongodb.org/">MongoDB</a> is an open source document-oriented

data store with a Binary Object Notation (BSON) storage format that is

JSON-style and familiar to web developers.

<a href="http://docs.mongodb.org/ecosystem/drivers/python/">PyMongo</a> is the most

commonly used client to interface with MongoDB through Python code.</p>

</li>

<li>

<p><a href="http://basho.com/riak/">Riak</a> is an open source distributed data store

focused on availability, fault tolerance and large scale deployments.</p>

</li>

<li>

<p><a href="http://couchdb.apache.org/">Apache CouchDB</a> is also an open source project

where the focus is on embracing RESTful-style HTTP access for working with

stored JSON data.</p>

</li>

</ul>

<h3>Document-oriented data store resources</h3>

<ul>

<li>

<p><a href="http://www.optinidus.com/blogs/guide-to-mongodb-for-startups/">MongoDB for startups</a>

is a guide about using non-relational databases in green field environments.</p>

</li>

<li>

<p>The creator and maintainers of PyMongo review four decisions they regret

from building the widely-used Python MongoDB driver.</p>

<ol>

<li><a href="http://emptysqua.re/blog/good-idea-at-the-time-pymongo-start-request/">start_request</a></li>

<li><a href="http://emptysqua.re/blog/it-seemed-like-a-good-idea-at-the-time-pymongo-use-greenlets/">use_greenlets</a></li>

<li><a href="http://emptysqua.re/blog/good-idea-at-the-time-pymongo-copy-database/">"copy_database"</a></li>

<li>The final post will cover MongoReplicaSetClient. </li>

</ol>

</li>

</ul>

<h2>Column-family table</h2>

<p>A the column-family table class of NoSQL data stores builds on the key-value

pair type. Each key-value pair is considered a row in the store while the

column family is similar to a table in the relational database model.</p>

<h3>Column-family table data stores</h3>

<ul>

<li>

<p>Apache <a href="https://hbase.apache.org/">HBase</a></p>

</li>

<li>

<p>Apache <a href="http://cassandra.apache.org/">Cassandra</a></p>

</li>

</ul>

<h2>Graph</h2>

<p>A graph database represents and stores data in three aspects: nodes, edges,

and properties. </p>

<p>A <em>node</em> is an entity, such as a person or business. </p>

<p>An <em>edge</em> is the relationship between two entities. For example, an

edge could represent that a node for a person entity is an employee of a

business entity. </p>

<p>A <em>property</em> represents information about nodes. For example, an entity

representing a person could have a property of "female" or "male".</p>

<h3>Graph data stores</h3>

<ul>

<li>

<p><a href="http://www.neo4j.org/">Neo4j</a> is one of the most widely used graph

databases and runs on the Java Virtual Machine stack.</p>

</li>

<li>

<p><a href="https://github.com/google/cayley">Cayley</a> is an open source graph data

store written by Google primarily written in Go.</p>

</li>

<li>

<p><a href="http://thinkaurelius.github.io/titan/">Titan</a> is a distributed graph

database built for multi-node clusters.</p>

</li>

</ul>

<h3>Graph data store resources</h3>

<ul>

<li><a href="http://www.slideshare.net/maxdemarzi/introduction-to-graph-databases-12735789">Introduction to Graph Databases</a>

covers trends in NoSQL data stores and compares graph databases to other

data store types.</li>

</ul>

<h2>NoSQL third-party services</h2>

<ul>

<li><a href="http://www.mongohq.com/home">MongoHQ</a> provides MongoDB as a service. It's

easy to set up with either a standard LAMP stack or on Heroku.</li>

</ul>

<h2>NoSQL data store resources</h2>

<ul>

<li>

<p><a href="http://www.thoughtworks.com/insights/blog/nosql-databases-overview">NoSQL databases: an overview</a>

explains what NoSQL means, how data is stored differently than in

relational systems and what the Consistency, Availability and

Partition-Tolerance (CAP) Theorem means.</p>

</li>

<li>

<p><a href="http://natishalom.typepad.com/nati_shaloms_blog/2010/10/nocap.html">CAP Theorem overview</a>

presents the basic constraints all databases must trade off in operation.</p>

</li>

<li>

<p>This post on <a href="http://jeffknupp.com/blog/2014/09/01/what-is-a-nosql-database-learn-by-writing-one-in-python/">What is a NoSQL database? Learn By Writing One in Python</a>

is a detailed article that breaks the mystique behind what some forms

of NoSQL databases are doing under the covers.</p>

</li>

<li>

<p><a href="http://www.nosqlweekly.com/">NoSQL Weekly</a> is a free curated email

newsletter that aggregates articles, tutorials, and videos about

non-relational data stores.</p>

</li>

<li>

<p><a href="http://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis">NoSQL comparison</a>

is a large list of popular, BigTable-based, special purpose, and other

datastores with attributes and the best use cases for each one.</p>

</li>

</ul>

<h2>NoSQL data stores learning checklist</h2>

Understand why NoSQL data stores are better for some use cases than relational

databases. In general these benefits are only seen at large scale so they may

not be applicable to your web application.</p>

Integrate Redis into your project for a speed boost over slower persistent

storage. Storing session data in memory is generally much faster than saving

that data in a traditional relational database that uses persistent storage.

Note that when memory is flushed the data goes away so anything that needs to

be persistent must still be backed up to disk on a regular basis.</p>

Evaluate other use cases such as storing transient logs in document-oriented

data stores such as MongoDB.</p>

Tell me more about standard relational databases.

</p>

</div>

</a>

My app is running but looks awful. How do I style the interface?

</p>

</div>

How do I create a better browser experience with JavaScript?

</p>

</div>

</div> <style type="text/css">

#mc_embed_signup{background:#fff; clear:left; font:12px "Helvetica Neue",Arial,sans-serif; }

/* Add your own MailChimp form style overrides in your site stylesheet or in this style block.

We recommend moving this block and the preceding CSS link to the HEAD of your HTML file. */

</style>

<hr/>

<h4>Interested in a complete Full Stack Python book with detailed tutorials and example code? Sign up here and you'll get an alert email if a book is created. No other emails will be sent other than sign up confirmation.</h4>

<label for="mce-EMAIL">Email Address</label>

</div>

</div>

</div>

</div>

</form>

</div>

var fnames = new Array();var ftypes = new Array();fnames[0]='EMAIL';ftypes[0]='email';fnames[1]='FNAME';ftypes[1]='text';fnames[2]='LNAME';ftypes[2]='text';

try {

var jqueryLoaded=jQuery;

jqueryLoaded=true;

} catch(err) {

var jqueryLoaded=false;

}

var head= document.getElementsByTagName('head')[0];

if (!jqueryLoaded) {

var script = document.createElement('script');

script.type = 'text/javascript';

script.src = '//ajax.googleapis.com/ajax/libs/jquery/1.4.4/jquery.min.js';

head.appendChild(script);

if (script.readyState && script.onload!==null){

script.onreadystatechange= function () {

if (this.readyState == 'complete') mce_preload_check();

}

var err_style = '';

try{

err_style = mc_custom_error_style;

} catch(e){

err_style = '#mc_embed_signup input.mce_inline_error{border-color:#6B0505;} #mc_embed_signup div.mce_inline_error{margin: 0 0 1em 0; padding: 5px 10px; background-color:#6B0505; font-weight: bold; z-index: 1; color:#fff;}';

}

var head= document.getElementsByTagName('head')[0];

var style= document.createElement('style');

style.type= 'text/css';

if (style.styleSheet) {

style.styleSheet.cssText = err_style;

} else {

style.appendChild(document.createTextNode(err_style));

}

head.appendChild(style);

setTimeout('mce_preload_check();', 250);

var mce_preload_checks = 0;

function mce_preload_check(){

if (mce_preload_checks>40) return;

mce_preload_checks++;

try {

var jqueryLoaded=jQuery;

} catch(err) {

setTimeout('mce_preload_check();', 250);

return;

}

var script = document.createElement('script');

script.type = 'text/javascript';

script.src = 'http://downloads.mailchimp.com/js/jquery.form-n-validate.js';

head.appendChild(script);

try {

var validatorLoaded=jQuery("#fake-form").validate({});

} catch(err) {

setTimeout('mce_preload_check();', 250);

return;

}

mce_init_form();

}

function mce_init_form(){

jQuery(document).ready( function($) {

var options = { errorClass: 'mce_inline_error', errorElement: 'div', onkeyup: function(){}, onfocusout:function(){}, onblur:function(){} };

var mce_validator = $("#mc-embedded-subscribe-form").validate(options);

$("#mc-embedded-subscribe-form").unbind('submit');//remove the validator so we can get into beforeSubmit on the ajaxform, which then calls the validator

options = { url: 'http://mattmakai.us2.list-manage.com/subscribe/post-json?u=b7e774f0c4f05dcebbfee183d&id=b22335388d&c=?', type: 'GET', dataType: 'json', contentType: "application/json; charset=utf-8",

beforeSubmit: function(){

$('#mce_tmp_error_msg').remove();

$('.datefield','#mc_embed_signup').each(

function(){

var txt = 'filled';

var fields = new Array();

var i = 0;

$(':text', this).each(

function(){

fields[i] = this;

i++;

});

$(':hidden', this).each(

function(){

var bday = false;

if (fields.length == 2){

bday = true;

fields[2] = {'value':1970};//trick birthdays into having years

}

if ( fields[0].value=='MM' && fields[1].value=='DD' && (fields[2].value=='YYYY' || (bday && fields[2].value==1970) ) ){

this.value = '';

} else if ( fields[0].value=='' && fields[1].value=='' && (fields[2].value=='' || (bday && fields[2].value==1970) ) ){

this.value = '';

} else {

if (/\[day\]/.test(fields[0].name)){

this.value = fields[1].value+'/'+fields[0].value+'/'+fields[2].value;

} else {

this.value = fields[0].value+'/'+fields[1].value+'/'+fields[2].value;

}

});

$('.phonefield-us','#mc_embed_signup').each(

function(){

var fields = new Array();

var i = 0;

$(':text', this).each(

function(){

fields[i] = this;

i++;

});

$(':hidden', this).each(

function(){

if ( fields[0].value.length != 3 || fields[1].value.length!=3 || fields[2].value.length!=4 ){

this.value = '';

} else {

this.value = 'filled';

}

});

return mce_validator.form();

success: mce_success_cb

};

$('#mc-embedded-subscribe-form').ajaxForm(options);

});

}

function mce_success_cb(resp){

$('#mce-success-response').hide();

$('#mce-error-response').hide();

if (resp.result=="success"){

$('#mce-'+resp.result+'-response').show();

$('#mce-'+resp.result+'-response').html(resp.msg);

$('#mc-embedded-subscribe-form').each(function(){

this.reset();

});

} else {

var index = -1;

var msg;

try {

var parts = resp.msg.split(' - ',2);

if (parts[1]==undefined){

msg = resp.msg;

} else {

i = parseInt(parts[0]);

if (i.toString() == parts[0]){

index = parts[0];

msg = parts[1];

} else {

index = -1;

msg = resp.msg;

}

} catch(e){

index = -1;

msg = resp.msg;

}

try{

if (index== -1){

$('#mce-'+resp.result+'-response').show();

$('#mce-'+resp.result+'-response').html(msg);

} else {

err_id = 'mce_tmp_error_msg';

html = '<div id="'+err_id+'" style="'+err_style+'"> '+msg+'</div>';

var input_id = '#mc_embed_signup';

var f = $(input_id);

if (ftypes[index]=='address'){

input_id = '#mce-'+fnames[index]+'-addr1';

f = $(input_id).parent().parent().get(0);

} else if (ftypes[index]=='date'){

input_id = '#mce-'+fnames[index]+'-month';

f = $(input_id).parent().parent().get(0);

} else {

input_id = '#mce-'+fnames[index];

f = $().parent(input_id).get(0);

}

if (f){

$(f).append(html);

$(input_id).focus();

} else {

$('#mce-'+resp.result+'-response').show();

$('#mce-'+resp.result+'-response').html(msg);

}

} catch(e){

$('#mce-'+resp.result+'-response').show();

$('#mce-'+resp.result+'-response').html(msg);

}

</script>

</div>

<div class="panel-heading"><h3 class="panel-head">NoSQL Data Stores</h3></div>

<a href="/">Full Stack Python</a> is an open book that explains

each Python web application stack layer and provides the

best web resources for those topics.

<hr/>

There's a work-in-progress

<a href="/full-stack-python-map.pdf">subjects map (.pdf)</a>

that visually lays out each chapter in addition to the table of

contents found below.

<hr/>

Need more detailed tutorials and walkthroughs than what is

presented here?

<a href="/email.html">Sign up for an email alert when that content is created.</a>

<hr/>

<a href="http://twitter.com/mattmakai">Matt Makai</a> built

this site with assistance from community pull requests. On GitHub

you can <a href="https://github.com/makaimc">follow Matt</a>

to see the daily changes.

</div>

<h3 class="panel-head">Table of Contents</h3>

</div>

<a href="/introduction.html" class="list-group-item smaller-item ">Introduction</a>

<a href="/web-frameworks.html" class="list-group-item smaller-item ">Web Frameworks</a>

<a href="/django.html" class="list-group-item smaller-item ">Django</a>

<a href="/flask.html" class="list-group-item smaller-item ">Flask</a>

<a href="/bottle.html" class="list-group-item smaller-item ">Bottle</a>

<a href="/morepath.html" class="list-group-item smaller-item ">Morepath</a>

<a href="/other-web-frameworks.html" class="list-group-item smaller-item ">Other Web Frameworks</a>

<a href="/deployment.html" class="list-group-item smaller-item ">Deployment</a>

<a href="/servers.html" class="list-group-item smaller-item ">Servers</a>

<a href="/platform-as-a-service.html" class="list-group-item smaller-item ">Platform-as-a-service</a>

<a href="/operating-systems.html" class="list-group-item smaller-item ">Operating Systems</a>

<a href="/web-servers.html" class="list-group-item smaller-item ">Web Servers</a>

<a href="/wsgi-servers.html" class="list-group-item smaller-item ">WSGI Servers</a>

<a href="/source-control.html" class="list-group-item smaller-item ">Source Control</a>

<a href="/application-dependencies.html" class="list-group-item smaller-item ">Application Dependencies</a>

<a href="/databases.html" class="list-group-item smaller-item ">Databases</a>

<a href="/no-sql-datastore.html" class="list-group-item smaller-item active">NoSQL Data Stores</a>

<a href="/web-design.html" class="list-group-item smaller-item ">Web Design</a>

<a href="/cascading-style-sheets.html" class="list-group-item smaller-item ">Cascading Style Sheets</a>

<a href="/javascript.html" class="list-group-item smaller-item ">JavaScript</a>

<a href="/continuous-integration.html" class="list-group-item smaller-item ">Continuous Integration</a>

<a href="/code-metrics.html" class="list-group-item smaller-item ">Code Metrics</a>

<a href="/configuration-management.html" class="list-group-item smaller-item ">Configuration Management</a>

<a href="/static-content.html" class="list-group-item smaller-item ">Static Content</a>

<a href="/caching.html" class="list-group-item smaller-item ">Caching</a>

<a href="/task-queues.html" class="list-group-item smaller-item ">Task Queues</a>

<a href="/application-programming-interfaces.html" class="list-group-item smaller-item ">Application Programming Interfaces</a>

<a href="/api-integration.html" class="list-group-item smaller-item ">API Integration</a>

<a href="/api-creation.html" class="list-group-item smaller-item ">API Creation</a>

<a href="/logging.html" class="list-group-item smaller-item ">Logging</a>

<a href="/monitoring.html" class="list-group-item smaller-item ">Monitoring</a>

<a href="/web-analytics.html" class="list-group-item smaller-item ">Web Analytics</a>

<a href="/web-application-security.html" class="list-group-item smaller-item ">Web Application Security</a>

<a href="/best-python-resources.html" class="list-group-item smaller-item ">Best Python Resources</a>

<a href="/development-environments.html" class="list-group-item smaller-item ">Development Environments</a>

<a href="/about-author.html" class="list-group-item smaller-item ">About the Author</a>

<a href="/change-log.html" class="list-group-item smaller-item ">Change Log</a>

<a href="/future-directions.html" class="list-group-item smaller-item ">Future Directions</a>

<a href="/what-full-stack-means.html" class="list-group-item smaller-item ">What "Full Stack" Means</a>

<a href="/websockets.html" class="list-group-item smaller-item ">WebSockets</a>

</div>

</div></div>

<hr/>

<a href="http://www.mattmakai.com/" class="underline">Matt Makai</a>

2014

</div>

setTimeout(function(){var a=document.createElement("script");

var b=document.getElementsByTagName("script")[0];

a.src=document.location.protocol+"//dnn506yrbagrg.cloudfront.net/pages/scripts/0016/5846.js?"+Math.floor(new Date().getTime()/3600000);

a.async=true;a.type="text/javascript";b.parentNode.insertBefore(a,b)}, 1);

</script> <div style="display: none;">

</div>

</body>

</html>

fullstackpython.github.com/no-sql-datastore.html at gh-pages · aoracle/fullstackpython.github.com · GitHub

Expand file tree

Breadcrumbs

no-sql-datastore.html

Latest commit

History

Breadcrumbs

no-sql-datastore.html

File metadata and controls