This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
`ceph-devstack config dump` will output the current configuration.
### Shared block pool (optional)
To back loop devices with slices of a real NVMe device instead of sparse files,
configure `[block_pool]` in your config. The pool is shared across all
`testnode_*` containers. Each loop device uses that container's
`loop_device_size` for its backing region on the pool parent.
```toml
[block_pool]
parent = "/dev/nvme0n1p1" # or a dedicated whole disk
allow_enroll = true # first run only; unset afterward
[containers.testnode]
loop_device_size = "5G"
```
Requirements:
* Your user must be in the `disk` group and able to read/write the parent
device directly (enrollment writes a tail marker to the raw device).
* On a Fedora CoreOS podman machine (macOS), the `disk` group is defined in
`/usr/lib/group`, so `usermod -aG disk core` silently does nothing until the
group line is copied into `/etc/group`. `ceph-devstack doctor --fix` does
both; by hand, inside `podman machine ssh`:
```bash
grep -q '^disk:' /etc/group || grep '^disk:' /usr/lib/group | sudo tee -a /etc/group
sudo usermod -aG disk core
```
New `podman machine ssh` sessions then have the group.
* The parent must be empty, or already enrolled by ceph-devstack (tail marker
at the end of the device).
`ceph-devstack block-pool status` shows current allocations.
All pool device access (sysfs, `findmnt`, `blkid`, and the marker and probe
reads/writes via `dd`) runs on the container host, so a pool inside a podman
machine (macOS, `RemoteHost`) should work, but that setup is unverified. The
pool state file and its lock always stay on the local machine.
Each container picks host loop devices at create time: it needs
`loop_device_count` devices of `loop_device_size`, reuses any existing backing
files for that container name, then takes the lowest free loop numbers after
scanning what is already attached or claimed in the `disk_images` directory.
If `block_pool.json` is lost but the on-disk marker remains, start again to
reclaim the marker; the device is not reformatted. The old allocations are
forgotten, though, so regions that still hold data are refused as not empty
until they are wiped.
As an example, the following configuration will use a local image for paddles with the tag `TEST`; it will also create ten testnode containers; and will build its teuthology container from the git repo at `~/src/teuthology`:
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Block pool #56
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Block pool #56
Filter by extension
Viewed files
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
There are no files selected for viewing
Uh oh!
There was an error while loading. Please reload this page.