fullstackpython.com/no-sql-datastore.html at pre-jan-content-reorder · BasmaRG/fullstackpython.com · GitHub

History

338 lines (337 loc) · 18.5 KB

Raw

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

333

334

335

336

337

338

<!DOCTYPE html>

<title>NoSQL Data Stores - Full Stack Python</title>

<!--[if lt IE 9]>

<![endif]-->

<style>

.toc-indent {padding-left: 25px;}

.toc-more-indent {padding-left: 37px;}

</style>

var _gaq = _gaq || [];

_gaq.push(['_setAccount', 'UA-19910497-7']);

_gaq.push(['_trackPageview']);

(function() {

var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;

ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';

var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);

})();

</script> </head>

<body>

<span class="logo-title"><a href="/">Full Stack Python</a></span>

</div>

</div> <div class="row">

<h1>NoSQL Data Stores</h1>

<p>Relational databases store the vast majority of web application

persistent data. However, there are several alternative classifications of

storage representations.</p>

<ol>

<li>Key-value pair</li>

<li>Document-oriented</li>

<li>Column-family table</li>

<li>Graph</li>

</ol>

<p>These persistent data storage representations are commonly used to augment,

rather than completely replace, relational databases. The underlying

persistence type used by the NoSQL database often gives it different

performance characteristics than a relational database, with better results

on some types of read/writes and worse performance on others.</p>

<h2>Key-value Pair</h2>

<p>Key-value pair data stores are based

on <a href="http://en.wikipedia.org/wiki/Hash_table">hash map</a> data structures.</p>

<h3>Key-value pair data stores</h3>

<ul>

<li><a href="http://redis.io/">Redis</a> is an open source in-memory key-value pair data

store. Redis is often called "the Swiss Army Knife of web application

development." It can be used for caching, queuing, and storing session data

for faster access than a traditional relational database, among many other

use cases. <a href="https://github.com/andymccurdy/redis-py">Redis-py</a> is a solid

Python client to use with Redis.</li>

</ul>

<h3>Key-value pair resources</h3>

<ul>

<li>

<p>"<a href="https://www.digitalocean.com/community/tutorials/how-to-install-and-use-redis">How To Install and Use Redis</a>"

is a guide for getting up with the extremely useful in-memory data store.</p>

</li>

<li>

<p>This video on

<a href="https://www.youtube.com/watch?v=rP9EKvWt0zo">Scaling Redis at Twitter</a> is

a detailed look behind the scenes with a massive Redis deployment.</p>

</li>

<li>

<p><a href="http://charlesleifer.com/blog/walrus-lightweight-python-utilities-for-working-with-redis/">Walrus</a>

is a higher-level Python wrapper for Redis with some caching, querying

and data structure components build into the library.</p>

</li>

</ul>

<h2>Document-oriented</h2>

<p>A document-oriented database provides a semi-structured representation for

nested data. </p>

<h3>Document-oriented data stores</h3>

<ul>

<li>

<p><a href="http://www.mongodb.org/">MongoDB</a> is an open source document-oriented

data store with a Binary Object Notation (BSON) storage format that is

JSON-style and familiar to web developers.

<a href="http://docs.mongodb.org/ecosystem/drivers/python/">PyMongo</a> is the most

commonly used client to interface with MongoDB through Python code.</p>

</li>

<li>

<p><a href="http://basho.com/riak/">Riak</a> is an open source distributed data store

focused on availability, fault tolerance and large scale deployments.</p>

</li>

<li>

<p><a href="http://couchdb.apache.org/">Apache CouchDB</a> is also an open source project

where the focus is on embracing RESTful-style HTTP access for working with

stored JSON data.</p>

</li>

</ul>

<h3>Document-oriented data store resources</h3>

<ul>

<li>

<p><a href="http://www.optinidus.com/blogs/guide-to-mongodb-for-startups/">MongoDB for startups</a>

is a guide about using non-relational databases in green field environments.</p>

</li>

<li>

<p>The creator and maintainers of PyMongo review four decisions they regret

from building the widely-used Python MongoDB driver.</p>

<ol>

<li><a href="http://emptysqua.re/blog/good-idea-at-the-time-pymongo-start-request/">start_request</a></li>

<li><a href="http://emptysqua.re/blog/it-seemed-like-a-good-idea-at-the-time-pymongo-use-greenlets/">use_greenlets</a></li>

<li><a href="http://emptysqua.re/blog/good-idea-at-the-time-pymongo-copy-database/">"copy_database"</a></li>

<li>The final post will cover MongoReplicaSetClient. </li>

</ol>

</li>

</ul>

<h2>Column-family table</h2>

<p>A the column-family table class of NoSQL data stores builds on the key-value

pair type. Each key-value pair is considered a row in the store while the

column family is similar to a table in the relational database model.</p>

<h3>Column-family table data stores</h3>

<ul>

<li>

<p>Apache <a href="https://hbase.apache.org/">HBase</a></p>

</li>

<li>

<p>Apache <a href="http://cassandra.apache.org/">Cassandra</a></p>

</li>

</ul>

<h2>Graph</h2>

<p>A graph database represents and stores data in three aspects: nodes, edges,

and properties. </p>

<p>A <em>node</em> is an entity, such as a person or business. </p>

<p>An <em>edge</em> is the relationship between two entities. For example, an

edge could represent that a node for a person entity is an employee of a

business entity. </p>

<p>A <em>property</em> represents information about nodes. For example, an entity

representing a person could have a property of "female" or "male".</p>

<h3>Graph data stores</h3>

<ul>

<li>

<p><a href="http://www.neo4j.org/">Neo4j</a> is one of the most widely used graph

databases and runs on the Java Virtual Machine stack.</p>

</li>

<li>

<p><a href="https://github.com/google/cayley">Cayley</a> is an open source graph data

store written by Google primarily written in Go.</p>

</li>

<li>

<p><a href="http://thinkaurelius.github.io/titan/">Titan</a> is a distributed graph

database built for multi-node clusters.</p>

</li>

</ul>

<h3>Graph data store resources</h3>

<ul>

<li><a href="http://www.slideshare.net/maxdemarzi/introduction-to-graph-databases-12735789">Introduction to Graph Databases</a>

covers trends in NoSQL data stores and compares graph databases to other

data store types.</li>

</ul>

<h2>NoSQL third-party services</h2>

<ul>

<li><a href="http://www.mongohq.com/home">MongoHQ</a> provides MongoDB as a service. It's

easy to set up with either a standard LAMP stack or on Heroku.</li>

</ul>

<h2>NoSQL data store resources</h2>

<ul>

<li>

<p><a href="http://www.thoughtworks.com/insights/blog/nosql-databases-overview">NoSQL databases: an overview</a>

explains what NoSQL means, how data is stored differently than in

relational systems and what the Consistency, Availability and

Partition-Tolerance (CAP) Theorem means.</p>

</li>

<li>

<p><a href="http://natishalom.typepad.com/nati_shaloms_blog/2010/10/nocap.html">CAP Theorem overview</a>

presents the basic constraints all databases must trade off in operation.</p>

</li>

<li>

<p>This post on <a href="http://jeffknupp.com/blog/2014/09/01/what-is-a-nosql-database-learn-by-writing-one-in-python/">What is a NoSQL database? Learn By Writing One in Python</a>

is a detailed article that breaks the mystique behind what some forms

of NoSQL databases are doing under the covers.</p>

</li>

<li>

<p><a href="http://www.nosqlweekly.com/">NoSQL Weekly</a> is a free curated email

newsletter that aggregates articles, tutorials, and videos about

non-relational data stores.</p>

</li>

<li>

<p><a href="http://kkovacs.eu/cassandra-vs-mongodb-vs-couchdb-vs-redis">NoSQL comparison</a>

is a large list of popular, BigTable-based, special purpose, and other

datastores with attributes and the best use cases for each one.</p>

</li>

</ul>

<h2>NoSQL data stores learning checklist</h2>

Understand why NoSQL data stores are better for some use cases than relational

databases. In general these benefits are only seen at large scale so they may

not be applicable to your web application.</p>

Integrate Redis into your project for a speed boost over slower persistent

storage. Storing session data in memory is generally much faster than saving

that data in a traditional relational database that uses persistent storage.

Note that when memory is flushed the data goes away so anything that needs to

be persistent must still be backed up to disk on a regular basis.</p>

Evaluate other use cases such as storing transient logs in document-oriented

data stores such as MongoDB.</p>

Tell me more about standard relational databases.

</p>

</div>

</a>

My app is running but looks awful. How do I style the interface?

</p>

</div>

How do I create a better browser experience with JavaScript?

</p>

</div>

</div> <div id="mc_embed_signup">

<h4>Interested in major updates to this site or an alert when a complete Full Stack Python book with detailed example code is released? Sign up here and you'll an occasional email only when there's big news to report.</h4>

</div>

</div>

</form>

</div>

<h3 class="panel-head"><a href="/table-of-contents.html" style="color: #fff;">Table of Contents</a></h3>

</div>

<a href="/introduction.html" class="list-group-item smaller-item ">Introduction</a>

<a href="/web-frameworks.html" class="list-group-item smaller-item ">Web Frameworks</a>

<a href="/django.html" class="list-group-item smaller-item ">Django</a>

<a href="/flask.html" class="list-group-item smaller-item ">Flask</a>

<a href="/bottle.html" class="list-group-item smaller-item ">Bottle</a>

<a href="/morepath.html" class="list-group-item smaller-item ">Morepath</a>

<a href="/other-web-frameworks.html" class="list-group-item smaller-item ">Other Web Frameworks</a>

<a href="/deployment.html" class="list-group-item smaller-item ">Deployment</a>

<a href="/servers.html" class="list-group-item smaller-item ">Servers</a>

<a href="/platform-as-a-service.html" class="list-group-item smaller-item ">Platform-as-a-service</a>

<a href="/operating-systems.html" class="list-group-item smaller-item ">Operating Systems</a>

<a href="/web-servers.html" class="list-group-item smaller-item ">Web Servers</a>

<a href="/wsgi-servers.html" class="list-group-item smaller-item ">WSGI Servers</a>

<a href="/source-control.html" class="list-group-item smaller-item ">Source Control</a>

<a href="/application-dependencies.html" class="list-group-item smaller-item ">Application Dependencies</a>

<a href="/databases.html" class="list-group-item smaller-item ">Databases</a>

<a href="/no-sql-datastore.html" class="list-group-item smaller-item active">NoSQL Data Stores</a>

<a href="/web-design.html" class="list-group-item smaller-item ">Web Design</a>

<a href="/cascading-style-sheets.html" class="list-group-item smaller-item ">Cascading Style Sheets</a>

<a href="/javascript.html" class="list-group-item smaller-item ">JavaScript</a>

<a href="/continuous-integration.html" class="list-group-item smaller-item ">Continuous Integration</a>

<a href="/code-metrics.html" class="list-group-item smaller-item ">Code Metrics</a>

<a href="/configuration-management.html" class="list-group-item smaller-item ">Configuration Management</a>

<a href="/static-content.html" class="list-group-item smaller-item ">Static Content</a>

<a href="/caching.html" class="list-group-item smaller-item ">Caching</a>

<a href="/task-queues.html" class="list-group-item smaller-item ">Task Queues</a>

<a href="/application-programming-interfaces.html" class="list-group-item smaller-item ">Application Programming Interfaces</a>

<a href="/api-integration.html" class="list-group-item smaller-item ">API Integration</a>

<a href="/api-creation.html" class="list-group-item smaller-item ">API Creation</a>

<a href="/logging.html" class="list-group-item smaller-item ">Logging</a>

<a href="/monitoring.html" class="list-group-item smaller-item ">Monitoring</a>

<a href="/web-analytics.html" class="list-group-item smaller-item ">Web Analytics</a>

<a href="/web-application-security.html" class="list-group-item smaller-item ">Web Application Security</a>

<a href="/best-python-resources.html" class="list-group-item smaller-item ">Best Python Resources</a>

<a href="/development-environments.html" class="list-group-item smaller-item ">Development Environments</a>

<a href="/about-author.html" class="list-group-item smaller-item ">About the Author</a>

<a href="/change-log.html" class="list-group-item smaller-item ">Change Log</a>

<a href="/future-directions.html" class="list-group-item smaller-item ">Future Directions</a>

<a href="/what-full-stack-means.html" class="list-group-item smaller-item ">What "Full Stack" Means</a>

<a href="/why-use-python.html" class="list-group-item smaller-item ">Why Use Python?</a>

<a href="/websockets.html" class="list-group-item smaller-item ">WebSockets</a>

<a href="/docker.html" class="list-group-item smaller-item ">Docker</a>

</div>

<div class="panel-heading"><h3 class="panel-head">NoSQL Data Stores</h3></div>

<a href="/">Full Stack Python</a> is an open book that explains

each Python web application stack layer and provides the

best web resources for those topics.

<hr/>

There's a work-in-progress

<a href="/full-stack-python-map.pdf">subjects map (.pdf)</a>

that visually lays out each chapter in addition to the table of

contents found below.

<hr/>

Need more detailed tutorials and walkthroughs than you see here?

<a href="/email.html">Sign up for an email alert when that content is created.</a>

<hr/>

<a href="http://twitter.com/mattmakai">Matt Makai</a> built

this site with greatly appreciated assistance from community

<a href="https://github.com/makaimc/fullstackpython.github.com/pulls">pull requests</a>.

</div>

</div></div>

<hr/>

<a href="http://www.mattmakai.com/" class="underline">Matt Makai</a>

2015

</div>

</body>

</html>

fullstackpython.com/no-sql-datastore.html at pre-jan-content-reorder · BasmaRG/fullstackpython.com · GitHub

Expand file tree

Breadcrumbs

no-sql-datastore.html

Latest commit

History

Breadcrumbs

no-sql-datastore.html

File metadata and controls