test_cext failed with "AssertionError: Tests leaked 1 references" on aarch64 CentOS9 3.15 · Issue #159318 · python/cpython · GitHub

aarch64 CentOS9 3.15:https://buildbot.python.org/#/builders/2176/builds/393

Traceback (most recent call last):
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py", line 68, in <module>
    main()
    ~~~~^^
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py", line 62, in main
    raise AssertionError(f'Tests leaked {diff} references')
AssertionError: Tests leaked 1 references

Details:

Details

test_build (test.test_cext.TestPublicCpp.test_build) ... Using pip 26.2.1 from /var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/lib/python3.15/site-packages/pip (python 3.15)
Processing ./pkg
  Preparing metadata (pyproject.toml): started
  Running command Preparing metadata (pyproject.toml)
  Language: C++
  Source: extension.cpp
  CC env var: 'gcc'
  CXX env var: <missing>
  CFLAGS env var: <missing>
  CPPFLAGS env var: <missing>
  CXXFLAGS env var: <missing>
  extra_compile_args: ['-Wall', '-Wextra', '-Werror', '-DMODULE_NAME=_test_cppext', '-pedantic-errors', '-Wno-long-long']
  running dist_info
  creating /tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info
  writing /tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info/PKG-INFO
  writing dependency_links to /tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info/dependency_links.txt
  writing top-level names to /tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info/top_level.txt
  writing manifest file '/tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info/SOURCES.txt'
  reading manifest file '/tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info/SOURCES.txt'
  writing manifest file '/tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal__test_cppext.egg-info/SOURCES.txt'
  creating '/tmp/test_python_w3idw4fo/pip-modern-metadata-uagzi39i/internal_test_cppext-0.0.dist-info'
  Preparing metadata (pyproject.toml): finished with status 'done'
Building wheels for collected packages: internal__test_cppext
  Building wheel for internal__test_cppext (pyproject.toml): started
  Running command Building wheel for internal__test_cppext (pyproject.toml)
  Language: C++
  Source: extension.cpp
  CC env var: 'gcc'
  CXX env var: <missing>
  CFLAGS env var: <missing>
  CPPFLAGS env var: <missing>
  CXXFLAGS env var: <missing>
  extra_compile_args: ['-Wall', '-Wextra', '-Werror', '-DMODULE_NAME=_test_cppext', '-pedantic-errors', '-Wno-long-long']
  running bdist_wheel
  running build
  running build_ext
  building '_test_cppext' extension
  creating build/temp.linux-aarch64-cpython-315-pydebug
  /usr/bin/g++ -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fno-strict-overflow -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -g -Og -Wall -fPIC -I/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/include -I/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Include -I/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot -c extension.cpp -o build/temp.linux-aarch64-cpython-315-pydebug/extension.o -Wall -Wextra -Werror -DMODULE_NAME=_test_cppext -pedantic-errors -Wno-long-long
  creating build/lib.linux-aarch64-cpython-315-pydebug
  /usr/bin/g++ -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fno-strict-overflow -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -g -Og -Wall -shared build/temp.linux-aarch64-cpython-315-pydebug/extension.o -L. -o build/lib.linux-aarch64-cpython-315-pydebug/_test_cppext.cpython-315d-aarch64-linux-gnu.so
  installing to build/bdist.linux-aarch64/wheel
  running install
  running install_lib
  creating build/bdist.linux-aarch64/wheel
  copying build/lib.linux-aarch64-cpython-315-pydebug/_test_cppext.cpython-315d-aarch64-linux-gnu.so -> build/bdist.linux-aarch64/wheel/.
  running install_egg_info
  running egg_info
  creating internal__test_cppext.egg-info
  writing internal__test_cppext.egg-info/PKG-INFO
  writing dependency_links to internal__test_cppext.egg-info/dependency_links.txt
  writing top-level names to internal__test_cppext.egg-info/top_level.txt
  writing manifest file 'internal__test_cppext.egg-info/SOURCES.txt'
  reading manifest file 'internal__test_cppext.egg-info/SOURCES.txt'
  writing manifest file 'internal__test_cppext.egg-info/SOURCES.txt'
  Copying internal__test_cppext.egg-info to build/bdist.linux-aarch64/wheel/./internal__test_cppext-0.0-py3.15.egg-info
  running install_scripts
  creating build/bdist.linux-aarch64/wheel/internal_test_cppext-0.0.dist-info/WHEEL
  creating '/tmp/test_python_w3idw4fo/pip-ephem-wheel-cache-whd9lvft/wheels/42/f9/6f/a737c743343c993469bf5507202f7c6c5945c16f5929ebbe85/tmpew3g323y/.tmp-khu06ek7/internal_test_cppext-0.0-cp315-cp315d-linux_aarch64.whl' and adding 'build/bdist.linux-aarch64/wheel' to it
  adding '_test_cppext.cpython-315d-aarch64-linux-gnu.so'
  adding 'internal_test_cppext-0.0.dist-info/METADATA'
  adding 'internal_test_cppext-0.0.dist-info/WHEEL'
  adding 'internal_test_cppext-0.0.dist-info/top_level.txt'
  adding 'internal_test_cppext-0.0.dist-info/RECORD'
  removing build/bdist.linux-aarch64/wheel
  Building wheel for internal__test_cppext (pyproject.toml): finished with status 'done'
  Created wheel for internal__test_cppext: filename=internal_test_cppext-0.0-cp315-cp315d-linux_aarch64.whl size=34499 sha256=705c773ce4a82bfbfb5bba99323b0d59180cdbf11486e7030c5cea37987632bc
  Stored in directory: /tmp/test_python_w3idw4fo/pip-ephem-wheel-cache-whd9lvft/wheels/42/f9/6f/a737c743343c993469bf5507202f7c6c5945c16f5929ebbe85
Successfully built internal__test_cppext
Installing collected packages: internal__test_cppext
Successfully installed internal__test_cppext-0.0
__cplusplus: 201703

test_api_casts()
test_datetime()
test_macros()
test_unicode()
test_virtual_object()
add()

test_api_casts()
test_datetime()
test_macros()
test_unicode()
test_virtual_object()
add()

Traceback (most recent call last):
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py", line 68, in <module>
    main()
    ~~~~^^
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py", line 62, in main
    raise AssertionError(f'Tests leaked {diff} references')
AssertionError: Tests leaked 1 references
ERROR

Stdout:
Run: '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/bin/python' -X dev -m pip install --no-build-isolation '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/pkg' -v
Run: '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/bin/python' -X dev /var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py _test_cppext

======================================================================
ERROR: test_build (test.test_cext.TestPublicCpp.test_build)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/__init__.py", line 141, in test_build
    self.check_build('_test_cppext')
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/__init__.py", line 106, in check_build
    run_cmd('Tests', cmd)
    ~~~~~~~^^^^^^^^^^^^^^
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/__init__.py", line 81, in run_cmd
    subprocess.run(cmd, check=True, env=env)
    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/subprocess.py", line 692, in run
    raise CalledProcessError(retcode, process.args,
                             output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command ['/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/bin/python', '-X', 'dev', '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py', '_test_cppext'] returned non-zero exit status 1.

Stdout:
Run: '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/bin/python' -X dev -m pip install --no-build-isolation '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/pkg' -v
Run: '/var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/build_oot/build/test_python_416935æ/tempcwd/env/bin/python' -X dev /var/lib/buildbot/worker/cstratak-CentOS9-aarch64/3.15.cstratak-CentOS9-aarch64/build/Lib/test/test_cext/runtests.py _test_cppext

----------------------------------------------------------------------
Ran 4 tests in 26.316s

FAILED (errors=1)

Error seen on other buildbots:

AMD64 Alpine Linux 3.15: https://buildbot.python.org/#/builders/2114/builds/738
AMD64 FreeBSD16 3.15: https://buildbot.python.org/#/builders/2103/builds/175

Ah, the 3.14 is also affected, since I backported "Check for reference leak in test_cext" to 3.14. Affected buildbots:

s390x RHEL9 3.14: https://buildbot.python.org/#/builders/1696/builds/1588

There are also very surprising errors on AMD64 Debian root 3.14, I'm not sure that it's related to test_cext changes: https://buildbot.python.org/#/builders/1742/builds/1841

8 re-run tests:
    test_datetime test_decimal test_email test_math test_ntpath
    test_tokenize test_unicodedata test_weakref

2 tests failed:
    test_tokenize test_unicodedata

Logs of 4 errors:

Details

ERROR: test_squareroot (test.test_decimal.CIBMTestCases.test_squareroot)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_decimal.py", line 5955, in <lambda>
    tester = lambda self, f=filename: self.eval_file(directory + f)
                                      ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_decimal.py", line 306, in eval_file
    t = self.eval_line(line)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_decimal.py", line 328, in eval_line
    return self.eval_equation(s)
           ~~~~~~~~~~~~~~~~~~^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_decimal.py", line 381, in eval_equation
    for exception in Signals[self.decimal]:
                             ^^^^^^^^^^^^
AttributeError: 'CIBMTestCases' object has no attribute 'TEST_ALL'

and

ERROR: test_threaded_weak_value_dict_deepcopy (test.test_weakref.MappingTestCase.test_threaded_weak_value_dict_deepcopy)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_weakref.py", line 2057, in test_threaded_weak_value_dict_deepcopy
    self.check_threaded_weak_dict_copy(weakref.WeakValueDictionary, True)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_weakref.py", line 2029, in check_threaded_weak_dict_copy
    raise exc[0]
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_weakref.py", line 1986, in dict_copy
    _ = copy.deepcopy(d)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/copy.py", line 138, in deepcopy
    y = copier(memo)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/weakref.py", line 157, in __deepcopy__
    new[deepcopy(key, memo)] = o
        ~~~~~~~~^^^^^^^^^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/copy.py", line 157, in deepcopy
    y = _reconstruct(x, memo, *rv)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/copy.py", line 240, in _reconstruct
    state = deepcopy(state, memo)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/copy.py", line 131, in deepcopy
    y = copier(x, memo)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/copy.py", line 202, in _deepcopy_dict
    y[deepcopy(key, memo)] = deepcopy(value, memo)
                             ~~~~~~~~^^^^^^^^^^^^^
TypeError: 'int' object is not callable

and

ERROR: test_no_names_in_pua (test.test_unicodedata.UnicodeFunctionsTest.test_no_names_in_pua)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_unicodedata.py", line 181, in test_no_names_in_pua
    self.assertRaises(ValueError, self.db.name, char)
    ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/unittest/case.py", line 813, in assertRaises
    return context.handle('assertRaises', args, kwargs)
           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/unittest/case.py", line 247, in handle
    callable_obj(*args, **kwargs)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
TypeError: unicodedata.name() argument after ** must be a mapping, not _AssertRaisesContext

and

ERROR: test_random_files (test.test_tokenize.TestRoundtrip.test_random_files) (file='/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_type_annotations.py')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_tokenize.py", line 2204, in test_random_files
    self.check_roundtrip(f)
    ~~~~~~~~~~~~~~~~~~~~^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/test/test_tokenize.py", line 2039, in check_roundtrip
    bytes_from5 = tokenize.untokenize(tokens5)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/tokenize.py", line 341, in untokenize
    out = ut.untokenize(iterable)
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/tokenize.py", line 262, in untokenize
    self.add_whitespace(start)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^
  File "/root/buildarea/3.14.angelico-debian-amd64/build/Lib/tokenize.py", line 178, in add_whitespace
    raise ValueError("start ({},{}) precedes previous end ({},{})"
                     .format(row, col, self.prev_row, self.prev_col))
ValueError: start (291,33) precedes previous end (292,0)

I prepared two PRs to fix this issue:

3.15: [3.15] gh-157649: Use more warmups in test_cext to check for refleaks #159374
3.14: [3.14] gh-157649: Use more warmups in test_cext to check for refleaks #159375

I ran buildbots on them. I will see if this change fix the issue.

I merged the two changes. They seem to fix the refleak warning. So I close the issuse.

test_cext failed with "AssertionError: Tests leaked 1 references" on aarch64 CentOS9 3.15 · Issue #159318 · python/cpython · GitHub

Repository navigation

test_cext failed with "AssertionError: Tests leaked 1 references" on aarch64 CentOS9 3.15 #159318

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

test_cext failed with "AssertionError: Tests leaked 1 references" on aarch64 CentOS9 3.15 · Issue #159318 · python/cpython · GitHub

Repository navigation

test_cext failed with "AssertionError: Tests leaked 1 references" on aarch64 CentOS9 3.15 #159318

Description

Activity

vstinner commented on Oct 13, 2026

vstinner commented on Oct 13, 2026

vstinner commented on Oct 13, 2026

vstinner commented on Oct 13, 2026

vstinner commented on Oct 13, 2026

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions