FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

chore(parallel tests): revamp parallel test outputs for searchability and clarity by chalmerlowe · Pull Request #17940 · googleapis/google-cloud-python · GitHub

/ google-cloud-python Public

chore(parallel tests): revamp parallel test outputs for searchability and clarity #17940

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
chalmerlowe merged 8 commits into from
Aug 3, 2026
+56 −26
Conversation 14 Commits 8 Checks 33 Files changed 1
Merged

chore(parallel tests): revamp parallel test outputs for searchability and clarity #17940

Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
82620ff
feat: revamp parallel test outputs for searchability and clarity
chalmerlowe Jul 30, 2026
ff39e73
test: add trigger comments and dummy test for mixed results
chalmerlowe Jul 30, 2026
7f903ea
chore: tweak experimental comment and blank lines in system.sh
chalmerlowe Jul 30, 2026
cb1a085
feat: add package lists to top of Failed and Succeeded sections
chalmerlowe Jul 30, 2026
665d059
Update packages/google-cloud-speech/setup.py
chalmerlowe Jul 31, 2026
9af2aae
Update packages/google-cloud-translate/setup.py
chalmerlowe Jul 31, 2026
a6de287
Update packages/google-cloud-dns/tests/system/test_system.py
chalmerlowe Jul 31, 2026
13d554c
Update packages/google-cloud-access-approval/setup.py
chalmerlowe Jul 31, 2026
File filter

Filter by extension

Filter by extension .sh  (1) All 1 file type selected
Viewed files
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Unified
Split
Hide whitespace
Diff view
Unified
Split
Hide whitespace
82 changes: 56 additions & 26 deletions .kokoro/system.sh
Show comments
View file
Open in desktop
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Show hidden characters
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,6 @@ run_package_test() {
# 🪤 TRAP: Ensure cleanup of THIS specific temp dir on exit of this subshell
trap 'rm -rf "$gcloud_config_dir"' EXIT


echo "------------------------------------------------------------"
echo "Configuring environment for: ${package_name}"
echo "------------------------------------------------------------"

case "${package_name}" in
"google-auth")
# Copy files needed for google-auth system tests
Expand All @@ -92,6 +87,14 @@ run_package_test() {
NOX_FILE="noxfile.py"
fi
;;
"google-cloud-dns")
# EXPERIMENTAL: Force running all system sessions to test mixed results. This will be reverted
# before merge. You can safely ignore it.
PROJECT_ID=$(cat "${KOKORO_GFILE_DIR}/project-id.json")
GOOGLE_APPLICATION_CREDENTIALS="${KOKORO_GFILE_DIR}/service-account.json"
NOX_FILE="noxfile.py"
NOX_SESSION="system"
;;
Comment thread
chalmerlowe marked this conversation as resolved.
*)
PROJECT_ID=$(cat "${KOKORO_GFILE_DIR}/project-id.json")
GOOGLE_APPLICATION_CREDENTIALS="${KOKORO_GFILE_DIR}/service-account.json"
Expand Down Expand Up @@ -125,7 +128,7 @@ run_package_test() {
reap_parallel_results() {
local retval=0
local failed_count=0
local passed_count=0
local succeeded_count=0

if [ -z "$LOG_DIR" ]; then
echo "Error: LOG_DIR is not set."
Expand All @@ -140,49 +143,76 @@ reap_parallel_results() {
done

local total_tested=${#PACKAGES_TO_TEST[@]}
passed_count=$((total_tested - failed_count))
succeeded_count=$((total_tested - failed_count))

echo ""
echo "=================================================="
echo " TEST RUN SUMMARY "
echo "@SUMMARY - TEST RUN RESULTS"
echo "=================================================="
echo "Total tested: $total_tested"
echo "Passed: $passed_count"
echo "Failed: $failed_count"
echo "Total Packages: $total_tested"
echo "Succeeded: $succeeded_count"
echo "Failed: $failed_count"
echo "=================================================="

local passed_packages=()
local succeeded_packages=()
for pkg in "${PACKAGES_TO_TEST[@]}"; do
if [ ! -f "$LOG_DIR/$pkg.failed" ]; then
passed_packages+=("$pkg")
succeeded_packages+=("$pkg")
fi
done

if [ ${#passed_packages[@]} -gt 0 ]; then
echo ""
echo "PASSED PACKAGES:"
printf "%s\n" "${passed_packages[@]}" | sort | sed 's/^/- /'
fi

if [ "$failed_count" -gt 0 ]; then
echo ""
echo "!!! DETAILED LOGS FOR FAILED PACKAGES !!!"
echo "=================================================="
echo "@FAILED - DETAILED LOGS FOR FAILED PACKAGES"
echo "=================================================="
# List failed packages
for failed in "$LOG_DIR"/*.failed; do
if [ -f "$failed" ]; then
basename "$failed" .failed
fi
done
for failed in "$LOG_DIR"/*.failed; do
if [ -f "$failed" ]; then
local pkg=$(basename "$failed" .failed)
echo "--------------------------------------------------"
echo "LOGS FOR: $pkg"
echo "@PACKAGE (FAILED): $pkg"
echo "--------------------------------------------------"
if [ -n "$KOKORO_ARTIFACTS_DIR" ] && [ -f "$KOKORO_ARTIFACTS_DIR/$pkg/sponge_log.log" ]; then
cat "$KOKORO_ARTIFACTS_DIR/$pkg/sponge_log.log"
else
elif [ -f "$LOG_DIR/$pkg.log" ]; then
cat "$LOG_DIR/$pkg.log"
else
echo "Warning: No log file found for failed package $pkg"
fi
echo ""
fi
done
retval=1
fi

if [ ${#succeeded_packages[@]} -gt 0 ]; then
echo "=================================================="
echo "@SUCCEEDED - DETAILED LOGS FOR SUCCEEDED PACKAGES"
echo "=================================================="
# List succeeded packages
for pkg in "${succeeded_packages[@]}"; do
echo "$pkg"
done
for pkg in "${succeeded_packages[@]}"; do
echo "--------------------------------------------------"
echo "@PACKAGE (SUCCEEDED): $pkg"
echo "--------------------------------------------------"
if [ -n "$KOKORO_ARTIFACTS_DIR" ] && [ -f "$KOKORO_ARTIFACTS_DIR/$pkg/sponge_log.log" ]; then
cat "$KOKORO_ARTIFACTS_DIR/$pkg/sponge_log.log"
elif [ -f "$LOG_DIR/$pkg.log" ]; then
cat "$LOG_DIR/$pkg.log"
else
echo "Warning: No log file found for succeeded package $pkg"
fi
echo ""
done
fi
Comment thread
chalmerlowe marked this conversation as resolved.

return $retval
}

Expand Down Expand Up @@ -272,9 +302,9 @@ export system_test_script PROJECT_ROOT KOKORO_GFILE_DIR
# -P "$MAX_JOBS" controls concurrency
# -I {} replaces {} with the package name
printf '%s\n' "${PACKAGES_TO_TEST[@]}" \
| xargs -P "$MAX_JOBS" -I {} \
| xargs -n 1 -P "$MAX_JOBS" \
bash -c '
pkg="$1"
pkg="$0"
# Determine log location: prefer Sponge artifacts directory if available
if [ -n "$KOKORO_ARTIFACTS_DIR" ]; then
pkg_log_dir="$KOKORO_ARTIFACTS_DIR/$pkg"
Expand All @@ -286,7 +316,7 @@ printf '%s\n' "${PACKAGES_TO_TEST[@]}" \

# Run test; if it fails, create a .failed file to signal failure to the reaper
run_package_test "$pkg" > "$log_file" 2>&1 || touch "$LOG_DIR/$pkg.failed"
' _ "{}"
'

reap_parallel_results || RETVAL=1

Expand Down
Loading
Back | FazBrowse Home | New Git URL