FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

Fix simdjson update script and update to v3.6.1 by anonrig · Pull Request #50986 · nodejs/node · GitHub

/ node Public

Fix simdjson update script and update to v3.6.1 - #50986

Closed
anonrig wants to merge 2 commits into
nodejs:mainfrom
anonrig:fix-simdjson-update-script
Closed

Fix simdjson update script and update to v3.6.1#50986
anonrig wants to merge 2 commits into
nodejs:mainfrom
anonrig:fix-simdjson-update-script

Conversation

anonrig commented Dec 1, 2023

Copy link
Copy Markdown
Member

There was a bug in update-simdjson.sh preventing us from updating to latest version. I've fixed it and updated simdjson to latest version.

anonrig added fast-track PRs that do not need to wait for 48 hours to land. commit-queue-rebase Add this label to allow the Commit Queue to land a PR in several commits. labels Dec 1, 2023

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/security-wg

nodejs-github-bot added dependencies Pull requests that update a dependency file. needs-ci PRs that need a full CI run. tools Issues and PRs related to the tools directory. labels Dec 1, 2023

github-actions Bot commented Dec 1, 2023

Copy link
Copy Markdown
Contributor

Fast-track has been requested by @anonrig. Please 👍 to approve.

anonrig added the request-ci Add this label to start a Jenkins CI on a PR. label Dec 1, 2023
anonrig force-pushed the fix-simdjson-update-script branch from 43ed739 to 07bc0be Compare December 1, 2023 00:33
anonrig added the author ready PRs that have at least one approval, no outstanding review comments, and a CI started. label Dec 1, 2023
github-actions Bot removed the request-ci Add this label to start a Jenkins CI on a PR. label Dec 1, 2023

Copy link
Copy Markdown
Collaborator

Copy link
Copy Markdown
Collaborator

Copy link
Copy Markdown
Contributor

Hello @anonrig while checking the status of the CI, I noticed that in both runs this PR had, all of the Windows ARM64 tests failed. From what I saw, the error always seems to be Error: Invalid package config and is usually triggered when calling modulesBinding.readPackageJSON.

cc @lemire

lemire commented Dec 1, 2023

Copy link
Copy Markdown
Member

@StefanStojanovic @anonrig The issue is verified. There has been a regression. Working a patch to fix this regression on ARM64 Windows.

lemire commented Dec 1, 2023
edited
Loading

Copy link
Copy Markdown
Member

@StefanStojanovic @anonrig The regression is with version 3.6. Version 3.5 did not have an issue.

Update. The regression is with 3.6.1. Version 3.6.0 is fine.

lemire commented Dec 1, 2023

Copy link
Copy Markdown
Member

Ok. Version 3.6.2 has the fix, and it is out:

https://github.com/simdjson/simdjson/releases/tag/v3.6.2

Copy link
Copy Markdown
Contributor

Ok. Version 3.6.2 has the fix, and it is out:

https://github.com/simdjson/simdjson/releases/tag/v3.6.2

Thanks for addressing this quickly!

lemire commented Dec 1, 2023
edited
Loading

Copy link
Copy Markdown
Member

@StefanStojanovic I bought an ARM-based developer kit for this very purpose.

It is precisely because I tried to fine tune the support that I got in trouble.

I am still unhappy about the code generation. I think Microsoft needs to generate better ARM binaries from Visual Studio. It is not at all at the level of LLVM.

If possible, I'd recommend building the Windows binaries with ClangCL. It would assuredly be faster.

Copy link
Copy Markdown
Contributor

@StefanStojanovic I bought an ARM-based developer kit for this very purpose.

It is precisely because I tried to fine tune the support that I got in trouble.

I am still unhappy about the code generation. I think Microsoft needs to generate better ARM binaries from Visual Studio. It is not at all at the level of LLVM.

If possible, I'd recommend building the Windows binaries with ClangCL. It would assuredly be faster.

I understand your concerns @lemire but currently, ClangCL cannot be used for building on Windows. One thing that comes to mind is for simdjson to use #ifdef to separate Clang and MSVC compilation on Windows. That way you'd be able to get better code generation with Clang, and MSVC would not have the regression.

lemire commented Dec 5, 2023

Copy link
Copy Markdown
Member

@StefanStojanovic The problem is not supporting Visual Studio, nor is it that it impacts other compilers (it does not, we already use macros).

The problem is that when you stare at the generated code from Visual Studio, you know that you are leaving performance on the table for no good reason.

The problem is that Visual Studio builds slowly and generate slow code compared to LLVM (clang):

https://lemire.me/blog/2023/02/27/visual-studio-versus-clangcl/

Google builds Chrome under Windows LLVM:

https://blog.llvm.org/2018/03/clang-is-now-used-to-build-chrome-for.html

Firefox is built using LLVM under Windows:

https://www.phoronix.com/news/Firefox-Clang-LTO-All-Platforms

targos commented Dec 5, 2023

Copy link
Copy Markdown
Member

I tried to build Node.js with ClangCL but there are many roadblocks. See #35433 (help appreciated!).

lemire commented Dec 5, 2023

Copy link
Copy Markdown
Member

@targos There you go!

anonrig force-pushed the fix-simdjson-update-script branch from 07bc0be to 190a019 Compare December 5, 2023 17:45
anonrig added the request-ci Add this label to start a Jenkins CI on a PR. label Dec 5, 2023
github-actions Bot removed the request-ci Add this label to start a Jenkins CI on a PR. label Dec 5, 2023

Copy link
Copy Markdown
Collaborator

Copy link
Copy Markdown
Collaborator

anonrig added the commit-queue Add this label to land a pull request using GitHub Actions. label Dec 6, 2023
nodejs-github-bot removed the commit-queue Add this label to land a pull request using GitHub Actions. label Dec 6, 2023

Copy link
Copy Markdown
Collaborator

Landed in c97322a...ac9e594

nodejs-github-bot pushed a commit that referenced this pull request Dec 6, 2023
PR-URL: #50986
Reviewed-By: Geoffrey Booth <webadmin@geoffreybooth.com>
Reviewed-By: Marco Ippolito <marcoippolito54@gmail.com>
nodejs-github-bot pushed a commit that referenced this pull request Dec 6, 2023
PR-URL: #50986
Reviewed-By: Geoffrey Booth <webadmin@geoffreybooth.com>
Reviewed-By: Marco Ippolito <marcoippolito54@gmail.com>
RafaelGSS pushed a commit that referenced this pull request Dec 15, 2023
PR-URL: #50986
Reviewed-By: Geoffrey Booth <webadmin@geoffreybooth.com>
Reviewed-By: Marco Ippolito <marcoippolito54@gmail.com>
RafaelGSS pushed a commit that referenced this pull request Dec 15, 2023
PR-URL: #50986
Reviewed-By: Geoffrey Booth <webadmin@geoffreybooth.com>
Reviewed-By: Marco Ippolito <marcoippolito54@gmail.com>
RafaelGSS mentioned this pull request Dec 15, 2023
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author ready PRs that have at least one approval, no outstanding review comments, and a CI started. commit-queue-rebase Add this label to allow the Commit Queue to land a PR in several commits. dependencies Pull requests that update a dependency file. fast-track PRs that do not need to wait for 48 hours to land. needs-ci PRs that need a full CI run. tools Issues and PRs related to the tools directory.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants


Back | FazBrowse Home | New Git URL