syncBKUP, a Bash script to that synchronises data directories and files to a backup repository. Only the most recent backup is stored in the repository. All changes and deletion to any directory or file between backups are kept in individual version directories. There are no limits on how long or how much historical data is kept, its user managed. This script is based on the capabilities of rsync.

Duplicate file finder, a Linux bash script that produces reports on duplicate & unique files using sha256 checksum. Input can be one or more directories with optional filters of maximum files size and parts of file names. Output is multiple CSV (spreadsheet) reports that can be used to move or delete duplicates in Linux, Windows-WSL, MSYS2, Gitbash

A small Linux app that creates test files filling them with random data in a single directory or a directory tree.

• Includes a calculator for creating data in directory trees.
• Can create a single file to a directory tree, tree size provided by user.
• File contents can either be printable or binary. All contents generated from /dev/urandom.
• Selecting the printable pool of characters determines the compressibility of file contents.
• Files sizes can be identical or randomly sized within a given range.
• Files can be identical or individually filled with random content.
• Run either interactively or unaccompanied in batch mode.

TestFilesCreate Datasheet Usage plus results testing data compression and data deduplication

Similar to testFilesCreate. Differences being: only produces a single directory of test files, has an option for sparse files and no calculator.

Makes test data for testing data storage, compression and transfer. The app can create test data files filled random selectable printable characters or binary data. Selecting printable content controls how compressible the test data is. There is a sparse file option. Files are created in a single directory. No data creation limits.

A script ( Bash & Powershell) that renames files, in a directory, that have generic meaningless names produced by phones, cameras log file genrators. This script will add the names of the parent directories as a prefix to current names. The script creates an executable log that will undo the renaming processing. The number of parent directory names you want to include in the prefix of the new name is selectable.

Calculations are theoretical and used to illustrate the dynamics of the impact deduplication. The calculator will not likely to match vendor calculations because there are many factors that influence deduplication capacity planning.

• Data that is encrypted and already compressed may render data deduplication ineffectove.
• Many data deduplication appliances and software will compress the stored data chunks.
• Files that are too small may be ignored by the deduplication process.

Download Data dedupe calculator (MS-Excel) macro free. The repro has examples of usage.

System, security and application administrators use command line mail tools like sendmail, postfix, mailx and mutt to mail out reports, alerts and other material to external people. These guides describe how setup up command line mail services using Proton Mail Bridge and mail-only SMTP services. SMTP services can used with Linux system utilities that are mail enabled, like cron.

Guide for installing, configuring and using the Mutt mail client with Proton Mail Bridge. Mutt is an option for those that do not have a domian to use.

Mutt_Proton_Mail-Bridge_Guide (PDF) The repo contains the muttrc and scripts

This guide describes how integrate Linux postfix to work with Proton Mail and Scaleway Transactional Email (TEM) secure SMTP services. Postfix when configured to work with a SMTP relay provides system and application administrators to use native and application mail tools to send reports, alerts and other information to external email addresses. The SMTP services of Proton and Scaleway are different in configuration requirements because they are designed for different workloads.

The guide is for separate installations, it does not cover configuring postfix to use Proton and Scaleway SMTP in the same computer.

• Postfix Installation and configuration with SASL/TLS security.
• Setting default email addresses with sender_canonical.
• Enabling preconfigured sender email addresses for Proton SMTP with sender_relay.
• Configuring cron and rsyslog ommail to send external mail.
• Testing and some troubleshooting.

This guide could be used for other Postfix SMTP mail installations.

A Guide for integrating Postfix with Proton Mail & Scaleway TEM SMTP servcies The repo contians configuration files