FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

Create Pregel and Neo4j Ingeration tutorials and add Pregel API to user guide by rjurney · Pull Request #578 · graphframes/graphframes · GitHub

/ graphframes Public

Create Pregel and Neo4j Ingeration tutorials and add Pregel API to user guide #578

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rjurney wants to merge 107 commits into
base: main
Choose a base branch
Could not load branches
Branch not found: {{ refName }}

Are you sure you want to change the base?

Some commits from the old base branch may be removed from the timeline, and old review comments may become outdated.
from
Conversation 28 Commits 107 Checks 11 Files changed
Open

Create Pregel and Neo4j Ingeration tutorials and add Pregel API to user guide #578

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
107 commits
Select commit Hold shift + click to select a range
f4e9cdb
Converted tests to pytest. Build a Python package. Update requirement…
rjurney Feb 16, 2025
c256244
Restore Python .gitignore
rjurney Feb 16, 2025
6c3df0b
Extra newline removed
rjurney Feb 16, 2025
b2838d2
Merge branch 'master' of github.com:graphframes/graphframes into rjur…
rjurney Feb 16, 2025
caf5091
Added VERSION file set to 0.8.5
rjurney Feb 16, 2025
7cfa2d1
isort; fiex edgesDF variable name.
rjurney Feb 16, 2025
2ca9a15
Merge branch 'master' of github.com:graphframes/graphframes into rjur…
rjurney Feb 16, 2025
a8bf0be
Back out Dockerfile changes
rjurney Feb 16, 2025
54a942d
Back out version change in build.sbt
rjurney Feb 16, 2025
8b0e346
Backout changes to config and run-tests
rjurney Feb 16, 2025
46c2b93
Back out pytest conversion
rjurney Feb 16, 2025
18b5da0
Back out version changes to make nose tests pass
rjurney Feb 16, 2025
8eca097
Remove changes to requirements
rjurney Feb 16, 2025
277c06f
Put nose back in requirements.txt
rjurney Feb 16, 2025
b55ee48
Remove version bump to version.sbt
rjurney Feb 16, 2025
f8a8fd9
Remove packages related to testing
rjurney Feb 16, 2025
bc2cb36
Remove old setup.py / setup.cfg
rjurney Feb 16, 2025
728be33
New pyproject.toml and poetry.lock
rjurney Feb 16, 2025
3cea1a8
Short README for Python package, poetry won't allow a ../README.md path
rjurney Feb 16, 2025
87cc975
Remove requirements files in favor of pyproject.toml
rjurney Feb 16, 2025
6f84a5a
Try to poetrize CI build
rjurney Feb 16, 2025
9a8eef0
pyspark min 3.4
rjurney Feb 16, 2025
75ecd99
Local python README in pyproject.toml
rjurney Feb 16, 2025
80231d0
Trying to remove he working folder to debug scala issue
rjurney Feb 16, 2025
2a9170b
Set Python working directory again
rjurney Feb 16, 2025
3de2263
Accidental newline
rjurney Feb 16, 2025
4662717
Install Python for test...
rjurney Feb 17, 2025
1b7b9f8
Run tests from python/ folder
rjurney Feb 17, 2025
58da493
Try running tests from python/
rjurney Feb 17, 2025
9f4aa24
poetry run the unit tests
rjurney Feb 17, 2025
11b2782
poetry run the tests
rjurney Feb 17, 2025
9772344
Try just using 'python' instead of a path
rjurney Feb 17, 2025
d55dbfe
poetry run the last line, graphframes.main
rjurney Feb 17, 2025
2fc4d08
Remove test/ folder from style paths, it doesn't exist
rjurney Feb 17, 2025
8297a13
Remove .vscode
rjurney Feb 17, 2025
2035d98
VERSION back to 0.8.4
rjurney Feb 17, 2025
f9f4bd7
Remove tutorials reference
rjurney Feb 17, 2025
9ddd6b2
VERSION is a Python thing, it belongs in python/
rjurney Feb 17, 2025
7065647
Include the README.md and LICENSE in the Python package
rjurney Feb 17, 2025
a6c7e91
Some classifiers for pyproject.toml
rjurney Feb 17, 2025
51e3e6d
Trying poetry install action instead of manual install
rjurney Feb 17, 2025
272be06
Removing SPARK_HOME
rjurney Feb 17, 2025
4587999
Returned SPARK_HOME settings
rjurney Feb 17, 2025
2422b22
Minimized the PR to just these files
rjurney Feb 17, 2025
073dced
Merge in rjurney/build-upgrades and in turn master
rjurney Feb 17, 2025
0a1faba
Created tutorials dependency group to minimize main bloat
rjurney Feb 17, 2025
c0d6d7b
Make motif.py execute in whole again
rjurney Feb 17, 2025
5bb4c26
Minor isort format and cleanup of download.py
rjurney Feb 17, 2025
99e6a4d
Minor isort format and cleanup of utils.py
rjurney Feb 17, 2025
662e197
Removed case sensitivity from the script - that was confusing people …
rjurney Feb 17, 2025
beaa35d
motif.py now matches tutorial code, runs and handles case insensitivity.
rjurney Feb 17, 2025
1bf4a9e
Regenerate poetry.lock
rjurney Feb 21, 2025
ef19784
Setup a 'graphframes stackexchange' comand.
rjurney Feb 21, 2025
4400cb4
Make graphframes.tutorials.motif use a checkpoint dir unique, and fro…
rjurney Feb 21, 2025
d549c56
Use spark.sparkContext.setCheckpointDir directly instead of instantia…
rjurney Feb 21, 2025
b970636
Using 'from __future__ import annotations' intsead of List and Tuple
rjurney Feb 21, 2025
3788941
Now retry three times if we can't connect for any reason in 'graphfra…
rjurney Feb 21, 2025
e95bbbe
Merge master
rjurney Feb 25, 2025
413a915
Merge branch 'master' of github.com:graphframes/graphframes
rjurney Mar 8, 2025
b6e8c27
Merge branch 'master' of github.com:graphframes/graphframes
rjurney Mar 18, 2025
a98afe1
Add starter Pregel tutorial, reference in index.md dropdown and globa…
rjurney Apr 15, 2025
caf005f
Added a pointer to Pregel in aggregateMessages API in User Guide
rjurney Apr 17, 2025
f3242fa
feat: Fleshed out Pregel re: aggregateMessages, bulk synchronous para…
rjurney Apr 17, 2025
2690092
feat: Fleshed out Pregel references
rjurney Apr 17, 2025
9b25035
Ignore spark-warehouse folder
rjurney Apr 18, 2025
a612c6f
feat: Mid-way through a Pregel tutorial. Implemented in-degree, now w…
rjurney Apr 18, 2025
3d3b113
feat: Filled in 0 degrees in in-degree example
rjurney Apr 18, 2025
6eac398
Added some diagrams, sourced them
rjurney Apr 18, 2025
4ffa82a
Rewrote introduction paragraph and title to include AggregateMessages.
rjurney Apr 18, 2025
690c723
Renamed 'Pregel API Tutorial' to 'Pregel and AggregateMessages API Tu…
rjurney Apr 18, 2025
6aca70e
Merge branch 'master' of github.com:graphframes/graphframes into rjur…
rjurney May 4, 2025
fd3c8fd
Merge main branch
rjurney Jul 12, 2025
d4dccd3
Ignore spark-warehouse/
rjurney Jul 12, 2025
90001ee
Added urls for Pluralsight GraphFrames classes
rjurney Jul 12, 2025
789e318
Trailing newline
rjurney Jul 12, 2025
6be4a68
Merge main branch to .gitignore/README.md and resolve conflicts
rjurney Jul 14, 2025
26c14eb
Merge rjurney/readme-3
rjurney Jul 14, 2025
fd91098
Completed in-degree in AggregateMessages, working on PageRank in Pregel
rjurney Jul 15, 2025
9684ad5
Merge master
rjurney Jul 17, 2025
59c537b
Merge master
rjurney Sep 9, 2025
b7a3738
Merge branch 'main' of github.com:graphframes/graphframes into rjurne…
rjurney Sep 25, 2025
8860619
Merge branch 'main' of github.com:graphframes/graphframes into rjurne…
rjurney Nov 18, 2025
3ca8f86
Converted Pregel tutorial HTML to Markdown
rjurney Nov 19, 2025
0a2a5ce
Remove old, Jekyll Pregel tutorial in favor of new one
rjurney Dec 10, 2025
d758aeb
Rough draft of entire Pregel tutorial
rjurney Dec 10, 2025
95c34a9
Merge branch 'graphframes:main' into rjurney/pregel-tutorial
rjurney Dec 17, 2025
b5350f2
Merge branch 'main' of github.com:graphframes/graphframes into rjurne…
rjurney Dec 24, 2025
7d9a82f
Lots of work making a Neo4j integration tutorial work.
rjurney Dec 25, 2025
02fc409
Merge branch 'rjurney/pregel-tutorial' of github.com:rjurney/graphfra…
rjurney Dec 25, 2025
a84d0d9
Merged main, ajusted pyproject increase of neo4j version and poetry l…
rjurney Jul 23, 2026
efe5a20
Updates to latest version in code and doing complete run-through to m…
rjurney Jul 24, 2026
80f3afd
Update pyproject.toml to add pre-commit as a dev dependency and fix a…
rjurney Jul 24, 2026
6fc828f
git pull rjurney/pyproject-numpy # And resolve conflicts
rjurney Jul 24, 2026
0855adf
Rewrite Pregel tutorial Label Propagation section around expression-c…
rjurney Jul 24, 2026
04237e7
Rewrite Combining Node Types section with real types and working type…
rjurney Jul 27, 2026
ee7ba1d
Merge branch 'main' of github.com:graphframes/graphframes into rjurne…
rjurney Jul 27, 2026
7eec98e
Merge and fix changes
rjurney Jul 27, 2026
04ba023
Add grpcio ^1.83.0 as a dev dependency and relock
rjurney Jul 28, 2026
82a4339
Removed grpcio
rjurney Jul 28, 2026
24322a3
Merge branch 'rjurney/pyproject-numpy' of github.com:rjurney/graphfra…
rjurney Jul 28, 2026
38da664
Potential fix for pull request finding
rjurney Jul 28, 2026
0f74041
Merge branch 'rjurney/pyproject-numpy' of github.com:rjurney/graphfra…
rjurney Jul 28, 2026
e8ed209
New poetry lock from previous commit
rjurney Jul 28, 2026
d17a2db
Merge poetry.lock
rjurney Jul 28, 2026
cfae3ec
Fix stale Spark 3.x reference
rjurney Jul 28, 2026
2ed3e88
Bump version required for this tutorial to 0.11.0
rjurney Jul 28, 2026
dbfe9a3
+pre-commit 4.6.1 dev dependency
rjurney Jul 29, 2026
File filter

Filter by extension

Filter by extension .lock  (1) .md  (2) .png  (4) .py  (9) .toml  (1) dotfile  (1) All 6 file types selected
Only manifest files
Viewed files
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Unified
Split
Hide whitespace
Diff view
Unified
Split
Hide whitespace
4 changes: 3 additions & 1 deletion .codespellrc
Show comments
View file
Open in desktop
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Show hidden characters
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,6 @@ skip = .git,*.lock,poetry.lock,*.iml,target,build,dist,*_pb2*.py,*_pb2_grpc.py,g
# fof/mye/protocall/alledges - local variable names (camelCase) in tests
# afterall - ScalaTest `afterAll` lifecycle override
# jurney - maintainer surname (Russell Jurney)
ignore-words-list = mis,te,ser,fof,mye,protocall,alledges,afterall,jurney
# brin - Sergey Brin, co-founder of Google (PageRank co-inventor)
# suppor - truncated word in verbatim Spark output in the Pregel tutorial
ignore-words-list = mis,te,ser,fof,mye,protocall,alledges,afterall,jurney,brin,suppor
Loading
Loading
Back | FazBrowse Home | New Git URL