FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

chore: Prepare for 2.0 release by plamut · Pull Request #278 · googleapis/python-bigquery · GitHub

This repository was archived by the owner on Mar 6, 2026. It is now read-only.
/ python-bigquery Public archive

chore: Prepare for 2.0 release - #278

Merged
crwilcox merged 22 commits into
googleapis:masterfrom
plamut:prepare-for-2-0
Sep 30, 2020
ConversationCommits (22)ChecksFiles changed
Merged

chore: Prepare for 2.0 release#278
crwilcox merged 22 commits into
googleapis:masterfrom
plamut:prepare-for-2-0

Conversation

plamut commented Sep 25, 2020 •
edited
Loading

Copy link
Copy Markdown
Contributor

This PR should serve as a preview of the 2.0 release.

For a start, the BQ Storage v1beta1 compatibility code is removed, as it will not be needed anymore once BQ Storage v2.0.0 is released.

TODO list:

  • Fix import paths in tests and samples that are affected by bigquery_v2 changes.
  • Describe bigquery_v2 changes in UPGRADING guide.
  • Fix docs, include bigquery_v2 in them, if necessary.

google-cla Bot added the cla: yes This human has signed the Contributor License Agreement. label Sep 25, 2020
plamut mentioned this pull request Sep 25, 2020
Merged
product-auto-label Bot added the api: bigquery Issues related to the googleapis/python-bigquery API. label Sep 26, 2020
tswast mentioned this pull request Sep 29, 2020
Closed
plamut added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Sep 29, 2020
yoshi-kokoro removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Sep 29, 2020

plamut commented Sep 29, 2020

Copy link
Copy Markdown
Contributor Author

BQ Storage 2.0.0 released, re-running.

tswast reviewed Sep 29, 2020
View reviewed changes
Comment thread setup.py
Comment thread UPGRADING.md
Comment thread docs/bigquery_v2/services.rst
Comment thread google/cloud/bigquery/dbapi/connection.py
Comment thread docs/bigquery_v2/types.rst
Comment thread google/cloud/bigquery/table.py Outdated
Comment thread google/cloud/bigquery_v2/services/__init__.py Outdated
Comment thread tests/unit/test_dbapi_connection.py
This was referenced Sep 29, 2020
Closed
Merged
This was referenced Sep 30, 2020
Closed
Closed
Closed
Closed

plamut commented Sep 30, 2020

Copy link
Copy Markdown
Contributor Author

FWIW, the snippets tests in samples/snippets fail because the generated noxfile tries to install BigQuery v1.x, but the snippets require v2.0.0 that is still in the making. They pass locally if INSTALL_LIBRARY_FROM_SOURCE env variable is set and the following patch is applied:

diff --git samples/snippets/noxfile.py samples/snippets/noxfile.py
index 5660f08..66589f5 100644
--- samples/snippets/noxfile.py
+++ samples/snippets/noxfile.py
@@ -158,14 +158,17 @@ def _session_tests(session, post_install=None):
         session.install("-r", "requirements-test.txt")
 
     if INSTALL_LIBRARY_FROM_SOURCE:
-        session.install("-e", _get_repo_root())
+        session.install("-e", _get_repo_root() + "[all]")
 
     if post_install:
         post_install(session)
 
diff --git samples/snippets/requirements.txt samples/snippets/requirements.txt
index 7fe8391..4753c47 100644
--- samples/snippets/requirements.txt
+++ samples/snippets/requirements.txt
@@ -1,4 +1,4 @@
-google-cloud-bigquery[pandas,bqstorage,pyarrow]==1.26.1
+# google-cloud-bigquery[pandas,bqstorage,pyarrow]==1.26.1
 google-auth-oauthlib==0.4.1
 ipython==7.16.1; python_version < '3.7'
 ipython==7.17.0; python_version >= '3.7'

tswast mentioned this pull request Sep 30, 2020
Closed

tswast commented Sep 30, 2020

Copy link
Copy Markdown
Contributor

They pass locally if INSTALL_LIBRARY_FROM_SOURCE env variable is set and the following patch is applied:

Do we need to add the necessary extras to requirements.txt?

Skip failing generated unit test
40eddb7 
The assertion seems to fail for a banal reason, i.e. an extra newline
in the string representation.

tswast commented Sep 30, 2020

Copy link
Copy Markdown
Contributor

Since it looks like requirements.txt is used to install packages, even when INSTALL_LIBRARY_FROM_SOURCE is set, I'm a bit confused as to why pandas isn't getting installed.

python-bigquery/samples/snippets/noxfile.py

Line 155 in fbbe0cb

session.install("-r", "requirements.txt")

Maybe I missed some logic that filters out google-cloud-bigquery[pandas,...] from that installation?

plamut commented Sep 30, 2020 •
edited
Loading

Copy link
Copy Markdown
Contributor Author

@tswast Ah, I think that's probably because I temporarily commented out the google-cloud-python line from requirements.txt completely, I just wanted to test with a local version of the library.

(and then had to adjust the installation from source line in noxfile to actually get all those extras installed)

plamut commented Sep 30, 2020
View reviewed changes
Comment thread testing/constraints-3.6.txt
plamut commented Sep 30, 2020
View reviewed changes
Comment thread testing/constraints-3.6.txt
plamut marked this pull request as ready for review September 30, 2020 17:36
plamut requested a review from a team September 30, 2020 17:36
plamut requested a review from a team as a code owner September 30, 2020 17:36
plamut requested a review from dinagraves September 30, 2020 17:36
Exclude generated services from the library
7a4084e 
There are currently no public API endpoints for the ModelServiceClient,
thus there is no point in generating that code in the first place.
tswast reviewed Sep 30, 2020
View reviewed changes
Comment thread testing/constraints-3.6.txt
Comment thread docs/bigquery_v2/services.rst
Comment thread docs/reference.rst
tswast reviewed Sep 30, 2020
View reviewed changes
Comment thread google/cloud/bigquery/model.py

crwilcox commented Sep 30, 2020

Copy link
Copy Markdown
Contributor

Hammer merging to work around sample tests.

crwilcox merged commit cbcb4b8 into googleapis:master Sep 30, 2020

plamut commented Sep 30, 2020

Copy link
Copy Markdown
Contributor Author

@crwilcox Thanks!

Release PR (#284) will probably need the same hammer love.

plamut deleted the prepare-for-2-0 branch September 30, 2020 22:52
plamut mentioned this pull request Oct 1, 2020
Closed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Show hidden characters
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

dinagraves Awaiting requested review from dinagraves
1 more reviewer
tswast tswast approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

api: bigquery Issues related to the googleapis/python-bigquery API. cla: yes This human has signed the Contributor License Agreement.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

Back | FazBrowse Home | New Git URL