| FazBrowse GitHub Viewer | Trending | | Home |
| Tools: [Download Repo ZIP] [Original HTTPS Page] |
Sorry, something went wrong.
Codecov Report❌ Patch coverage is 94.73684% with 1 line in your changes missing coverage. Please review.
@@ Coverage Diff @@
## main #15 +/- ##
==========================================
+ Coverage 83.71% 84.81% +1.09%
==========================================
Files 5 5
Lines 393 316 -77
==========================================
- Hits 329 268 -61
+ Misses 54 38 -16
Partials 10 10 ☔ View full report in Codecov by Sentry.
|
Sorry, something went wrong.
There was a problem hiding this comment.
This is interesting. Out of curiosity. what triggered this change? Who has discovered/highlighted the memory pressure issue?
Sorry, something went wrong.
|
Yes; regexes being "hungry" on resources is a known issue in general, which is also why Kir made various pull requests some time ago to try to reduce their use (e.g. docker/go-units#40), but this one cam through @tonistiigi who found that docker/buildx forgot to update docker/registry to the latest version, and as a result the distribution/reference package was loaded twice (once from docker/distribution/reference` and once from the new module. For a long-lived process / daemon, it's probably less problematic, but in the CLI, this resulted in nearly 2MB to be used just by importing those packages; here's from a Slack thread on that;
So this is an attempt at reducing such cases, and making the regexes compiled on first use. |
Sorry, something went wrong.
|
@thaJeztah now that #16 has been merged, wanna open this for review? |
Sorry, something went wrong.
| strategy: | ||
| matrix: | ||
| go-version: [1.20.x, 1.21.x] | ||
| go-version: [1.21.x, 1.22.x] |
There was a problem hiding this comment.
we should change this to 1.22.x and 1.23.x
Sorry, something went wrong.
|
We need to bump Go on this repo 🙈 |
Sorry, something went wrong.
|
@milosgajdos failure was because an invalid golangci-lint.yaml option (deadline was removed from the schema, and now had to be timeout, but both were deprecated in v2); I opened a PR to refresh CI, but it looks like the repository's config is looking for the Analyze (go) and CodeQL actions to start running, and .. they don't (or they have a different name now, for it to not find them 🫠); |
Sorry, something went wrong.
Using regex.MustCompile consumes a significant amount of memory when importing the package, even if those regular expressions are not used. This changes compiling the regular expressions to use a sync.OnceValue so that they're only compiled the first time they're used. There are various regular expressions remaining that are still compiled on import, but these are exported, so changing them to a sync.OnceValue would be a breaking change; we can still decide to do so, but leaving that for a follow-up. It's worth noting that sync.OnceValue requires go1.21 or up, so raising the minimum version accordingly. Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
| Back | FazBrowse Home | New Git URL |
use sync.OnceValue for various regular expressions, require go1.21
Using regex.MustCompile consumes a significant amount of memory when
importing the package, even if those regular expressions are not used.
This changes compiling the regular expressions to use a sync.OnceValue
so that they're only compiled the first time they're used.
There are various regular expressions remaining that are still compiled
on import, but these are exported, so changing them to a sync.OnceValue
would be a breaking change; we can still decide to do so, but leaving
that for a follow-up.
It's worth noting that sync.OnceValue requires go1.21 or up, so raising
the minimum version accordingly.
Before / After (on the docker CLI (GODEBUG=inittrace=1 ./build/docker)):