This project contains the infrastructure to test and extract MongoDB Java Sync Driver code examples for use across MongoDB documentation.

The structure of this Java project is as follows:

• /src/main/java: This directory contains example code and output to validate.
• /src/test/java: This directory contains the test infrastructure to actually run the tests by invoking the example code.

1. First-time setup
2. Set up environment
3. Create a new code example
4. Add a test for a new code example
5. Run tests locally (optional) or in CI
6. Snip code examples for inclusion in docs

Refer to the README at the root of the code-example-tests directory for information about how to use the tested code examples in your documentation project after you complete the snip step.

Before you can run tests or get Driver API hints in your IDE for new examples, you need to compile the project dependencies. This driver-sync project depends on utility libraries and dependencies that need to be built and loaded first.

This test suite was written with Java JDK Zulu v21 installed. If you do not yet have Java installed, install it. There are many ways to install Java, which is out of the scope of this README.

Separately, install Maven to build the utility libraries and load dependencies. For details about installing Maven, refer to Installing Apache Maven.

From the root of the /java directory (not the /driver-sync directory), run:

mvn clean install -DskipTests

This command will:

1. Compile the utility libraries (comparison tools and sample data helpers)
2. Install them to your local Maven repository so they can be used by driver-sync
3. Compile the driver-sync project code
4. Ensure all dependencies are properly resolved

You need to run this command:

• The first time you work with the project
• If you encounter dependency-related errors when running tests

Note: All Maven commands for running tests should be run from the /driver-sync directory, but this initial compilation must be run from the parent /java directory.

To create a new code example:

1. Create a code example file
2. Create an output file (optional)
3. Add a corresponding test - refer to the instructions below for testing
4. Run the snip.js script to move the tested code to a docs directory
5. Use the code example in a literalinclude or io-code-block in your docs set

If you're not comfortable adding a test, create this as an untested code example in your docs project's source/code-examples directory. Then, file a DOCSP ticket with the component set to DevDocs to request the DevDocs team move the file into this test project and add a test.

TLDR: from the /code-example-tests/java/driver-sync directory, run

export CONNECTION_STRING="<your_connection_string>" && mvn test && node snip

Create a new file in the src/main/java/ directory. Organize these examples to group related concepts - i.e. aggregation.pipelines or crud.insert. With the goal of single-sourcing code examples across different docs projects, avoid matching a specific docs project's page structure and instead group code examples by related concept or topic for easy reuse.

Refer to the main.java.example/ExampleStub.java file for an example you can copy/paste to stub out your own example.

If the output from the code example will be shown in the docs, create a file to store the output alongside the example. For example:

• aggregation.pipelines.filter.Tutorial.java
• aggregation.pipelines.filter.TutorialOutput.txt

To add a test for a new code example:

1. Create a new test case (optionally, in a new test file)
2. Define logic to verify the output matches expectations
3. Run the tests to confirm everything works

This test suite uses the JUnit testing framework to verify that our code examples compile, run, and produce the expected output when executed.

Each test file contains a class that groups together related test cases. Within the test class, you can execute many individual test cases, which are each annotated with a @Test and @DisplayName attribute.

You may choose to add a new @Test block to a group of related tests; for example, if you have a crud.insert test file, you might add tests for many insert operation examples. If there is no test file and class related to your code example, create a new file.

After the last @Test block in the file, create a new @Test block similar to:

@Test
@DisplayName("Test that filter aggregation pipeline matches output")
void TestFilter() {
  var example = new aggregation.pipelines.filter.Tutorial();
  example.loadSampleData();
  var output = example.runTutorial();

  Expect.that(output)
    .shouldMatch("src/main/java/aggregation/pipelines/filter/TutorialOutput.txt");
}

In the @Displayname annotation, give it a descriptive name that can help you and others understand the intent of the test, and easily find and debug any issues if the test should fail.

In the test case:

1. Call the function that runs your example
2. Capture the output to a variable
3. Verify that the output from running your example matches what you expect

Refer to the Define logic to verify the output section of this README for examples of different ways you can perform this verification.

If there is no test file that relates to your code example's topic, create a new test file. The naming convention is YourExampleFilenameTests.java.

You can nest these test files as deeply as needed to make them easy to find and organize.

Inside the test file, create a new class, similar to:

package test.aggregation.pipelines;

public class TutorialTests {

}

The package should match the directory structure where the file is located, and the class name should match the filename.

Inside each test class, you can add a setUp() and tearDown() function to execute some code before or after every test case, such as loading fresh sample data or dropping the database after performing a write operation to avoid cross-contaminating the tests.

Then, add a function annotated with the @Test attribute to add an individual test case. Refer to the "Add a test case to an existing file" section of this README for details.

Give it a descriptive @Displayname annotation.

For an example you can copy/paste to stub out your own test case, refer to test/java/test/example/ExampleStubTest.java.

You can verify the output in a few different ways:

1. Return a simple string from your example function, and use a strict match to confirm it matches expectations.
2. Use the Comparison library to validate output against the output we show in the documentation.

Some code examples might return a simple string. For example:

System.out.printf("Successfully created index named %s", result);
return String.format("Successfully created index named %s", result); // :remove:

In the test file, you can call the function that executes your code example, establish what the expected string should be, and perform a match to confirm that the code executed correctly:

var result = example.RunApp();
String expectedReturn = 'some output to verify in a test';
Expect.that(result)
  .shouldMatch(expectedReturn);

If you are showing the output in the docs, write the output to a file whose filename matches the example - i.e. TutorialOutput.txt. Then, use the Comparison library to validate that the actual output matches the expected output from the file:

var example = new aggregation.pipelines.filter.Tutorial();
example.loadSampleData();
var output = example.runTutorial();

Expect.that(output)
  .shouldMatch("src/main/java/aggregation/pipelines/filter/TutorialOutput.txt");

This test suite includes a comprehensive Comparison Library (mongodb.comparison.Expect) designed specifically for validating MongoDB Java Driver output against expected results.

• MongoDB Type Support: Automatically handles ObjectId, Decimal128, dates, and other MongoDB-specific types
• Multiple Input Formats: Supports JSON, JSONL, MongoDB Extended JSON, and POJO syntax
• Flexible Matching: Use ellipsis patterns (...) for dynamic content like timestamps or generated IDs
• Array Strategies: Configure ordered vs unordered array comparisons
• Field Exclusion: Ignore specific fields during comparison

import mongodb.comparison.Expect;

// Simple validation
var example = new aggregation.pipelines.filter.Tutorial();
example.loadSampleData();
var output = example.runTutorial();
Expect.that(results)
    .shouldMatch("src/main/java/aggregation/pipelines/filter/TutorialOutput.txt");

// With comparison options
Expect.that(results)
    // Unordered comparison is the default behavior
    .withIgnoredFields("_id", "createdAt")        // Ignore dynamic fields
    .shouldMatch("src/main/java/aggregation/pipelines/filter/TutorialOutput.txt");

// Ordered arrays (for aggregation pipelines, sorted results)
Expect.that(results)
    .withOrderedSort()
    .shouldMatch("src/main/java/aggregation/pipelines/filter/TutorialOutput.txt");

For cases where exact matching isn't appropriate—such as when document order varies or dynamic fields like _id differ between runs—use schema-based validation with shouldResemble():

import mongodb.comparison.Expect;
import mongodb.comparison.Schema;

// Basic schema validation - verify count and structure
Expect.that(actual).shouldResemble(expected).withSchema(
    Schema.builder()
        .withCount(5)                           // Expect exactly 5 documents
        .withRequiredFields("_id", "title")     // Each doc must have these fields
        .build()
);

// With field value constraints
Expect.that(actual).shouldResemble(expected).withSchema(
    Schema.builder()
        .withCount(3)
        .withRequiredFields("_id", "title", "year", "type")
        .withFieldValues(Map.of("type", "movie", "year", 2012))  // All docs must have these values
        .build()
);

The schema validation automatically normalizes inputs, so you can pass:

• Collections (List, Set, etc.)
• Arrays
• Single documents (auto-wrapped into a single-element list)

// All of these work:
Expect.that(singleDocument).shouldResemble(expectedList).withSchema(schema);
Expect.that(documentList).shouldResemble(singleDocument).withSchema(schema);
Expect.that(singleDoc).shouldResemble(anotherSingleDoc).withSchema(schemaWithCount1);

Schema validation is mutually exclusive with shouldMatch(). Additionally, schema validation does not support .withIgnoredFields(), .withOrderedSort(), or .withUnorderedSort(), since schema validation does not evaluate field values.

The library supports multiple formats in your expected output files:

MongoDB Extended JSON:

{ "date" : { "$date" : "2021-12-18T15:55:00Z" }, "name" : "Alice" }
{ "date" : { "$date" : "2021-12-18T15:56:00Z" }, "name" : "Bob" }

JSONL (Line-delimited JSON):

{"date": {"$date": "2021-12-18T15:55:00Z"}, "name": "Alice"}
{"date": {"$date": "2021-12-18T15:56:00Z"}, "name": "Bob"}

Java Object Syntax:

{ date: new DateTime(2021, 12, 18, 15, 55, 0), name: "Alice" }
{ date: new DateTime(2021, 12, 18, 15, 56, 0), name: "Bob" }

Use ... to match dynamic or variable content:

String truncation:

"username_abc123..."  // Matches any string starting with "username_abc123"

Object fields:

{ "name": "Alice", "profile": { "age": 30, ... } }  // Matches objects with at least these fields

Array elements:

["first", "second", ...]  // Matches arrays starting with these elements

This test suite includes a Sample Data Utility (sampledatautil) that allows tests to conditionally skip execution when MongoDB sample databases are not available. This provides a better experience for developers who may not have sample data loaded locally.

Mark tests that require sample data using the @RequiresSampleData annotation:

import sampledatautil.RequiresSampleData;

@Test
@RequiresSampleData("sample_mflix")
void testMovieAggregation() {
    // Test code that uses sample_mflix database
    var movies = collection.find(filter).into(new ArrayList<>());
    // ... rest of test
}

Alternatively, you can manually check sample data availability at the start of a test:

import sampledatautil.SampleDataTestHelper;

@Test
void testMovieAggregation() {
    // Check sample data availability (skips test if missing)
    SampleDataTestHelper.ensureSampleDataOrSkip("sample_mflix");

    // Test code that uses sample_mflix database
    var movies = collection.find(filter).into(new ArrayList<>());
    // ... rest of test
}

For tests requiring specific collections within a database:

@Test
@RequiresSampleData(value = "sample_mflix", collections = {"movies", "comments"})
void testCrossCollectionQuery() {
    // Test code using both collections
}

Or manually check for multiple databases:

@Test
void testCrossDatabaseQuery() {
    SampleDataTestHelper.ensureSampleDataOrSkip("sample_mflix", "movies");
    SampleDataTestHelper.ensureSampleDataOrSkip("sample_restaurants", "restaurants");

    // Test code using both databases
}

To run these tests locally, you need a local MongoDB deploy or an Atlas cluster. Save the connection string for use in the next step. If needed, see here for how to create a local deployment.

Create environment variables to use when running the tests. Depending on how you run the tests, you may do this in a few ways:

• Set them in your system through the terminal
• Add them in the IDE

The test suite requires the following environment variable:

• CONNECTION_STRING - your Atlas or local connection string

You can manually set these environment values through the terminal using the export command:

export CONNECTION_STRING="<your-connection-string>"

This is how we set the environment variables in CI. This sets the environment variables system-wide.

You can set the environment variables in a run configuration in your IDE. Refer to your IDE's instructions for how to do this.

If you have Maven installed, you can run tests from the command line. From the /code-example-tests/java/driver-sync directory, run:

mvn test

This command runs only the tests in the driver-sync module.

Important: You must set the CONNECTION_STRING environment variable before running tests, or the tests will fail to discover properly. See the Create environment variables section for details.

You can run all the tests in a given test class (file).

From the root of the /driver-sync directory, run:

mvn -Dtest=YourTestClassName test

For example:

mvn -Dtest=TutorialTests test

You can run a single test within a given test suite (file).

From the root of the /driver-sync directory, run:

mvn -Dtest=YourTestClassName#YourTestMethodName test

For example:

mvn -Dtest=TutorialTests#TestFilter test

A GitHub workflow runs these tests in CI automatically when you change any files in the examples directory:

• .github/workflows/java-driver-sync-examples-test-in-docker.yml

GitHub reports the results as passing or failing checks on any PR that changes an example.

If changing an example causes its test to fail, this should be considered blocking to merge the example.

If changing an example causes an unrelated test to fail, create a Jira ticket to fix the unrelated test, but this should not block merging an example update.

You can use markup to replace content that we do not want to show verbatim to users, remove test functionality from the outputted code examples, or rename awkward variables. You can find guides and reference documentation for this markup syntax here.

Inside your testable code example, add the comment // :snippet-start: <SNIPPET-NAME> where you want to start the snippet, and add // :snippet-end: to end the snippet. See an example in ExampleStub.java.

This test suite uses Bluehawk to generate code examples from the test files.

If you do not already have Bluehawk, install it with the following command:

npm install -g bluehawk

To generate updated example files, from the /driver-sync directory, run the snip script:

node snip.js

Note: if you run node run-tests.js, it snips all testable code examples automatically.

The updated example files output to content/code-examples/tested/java/driver-sync/. Subdirectory structure is also automatically transferred. For example, generating updated example files from code-example-tests/java/driver-sync/src/main/java/aggregation/pipelines/filter automatically outputs to content/code-examples/tested/java/driver-sync/aggregation/pipelines/filter.

This script will automatically create the specified output path if it does not exist.

Note: While uncommon, you might create files that you do not intend to include in the docs (such as a shared class file). If this is the case, you should add the file names to the IGNORE_PATTERNS constant in the snip.js file. For example, the following IGNORE_PATTERNS constant prevents snip.js from copying the ExampleStub.java file.

const IGNORE_PATTERNS = new Set(["ExampleStub.java"]);

This error typically occurs when the CONNECTION_STRING environment variable is not set. Make sure to set the environment variable before running tests:

export CONNECTION_STRING="your-mongodb-connection-string"
mvn test

Or set it inline:

CONNECTION_STRING="your-mongodb-connection-string" mvn test

This error typically occurs when the CONNECTION_STRING environment variable is not set. If you run mvn clean install without the -DskipTests during first-time setup, Maven automatically runs all the tests and you may encounter this error.

This should not prevent dependencies from installing correctly. You can safely ignore this error and configure the CONNECTION_STRING environment variable before you run tests manually.

To set it in the terminal session where you're running tests to persist for subsequent test runs:

export CONNECTION_STRING="your-mongodb-connection-string"
mvn test

Or set it inline when you run tests:

CONNECTION_STRING="your-mongodb-connection-string" mvn test