4.2. Fluid Output

Many fluid quantities defined at the level of the lattice are available for output. The fluid quantities include the lattice Boltzmann distributions, density and velocity, and order parameters if relevant. Output for some quantities is optional, while output for quantities required for restart will always be enabled automatically.

All files will appear in the current working directory. Files to be read are expected to exist in the current working directory at run time. Note that existing output files may be “clobbered” (overwritten) by new files of the same name if the code is run twice in the same location with the same input options.

4.2.1. I/O for all lattice quantities

There are a significant number of options related to the input and output of data. These concern the format of the data, the mechanism by which the data are produced, and reporting of input/output activity. The recommended options are:

default_io_mode           mpiio    # Use MPI-IO
default_io_format         binary   # ascii or binary
default_io_report         no       # produce a report on i/o

Here, the mode is the mechanism used to generate the output. The recommended mode is MPI-IO, which will always work and produce the same file irrespective of the number of MPI tasks. The format refers to the representation of data in files: either binary or ASCII is available. Binary format is recommended for reasons of speed and file size; for these reasons it is also the default. The report gives details on the performance of the output at each episode.

4.2.1.1. Control for specific lattice quantities

Input and output for different quantities are controlled by specific key value pairs. For example, options for the density field rho may be selected explicitly - overriding any default - using:

rho_io_mode               mpiio    # overrides default_io_mode
rho_io_format             binary   # overrides default_io_format
rho_io_report             yes      # overrides default_io_report

rho_input_io_format       ascii    # overrides rho_io_mode
rho_output_io_format      binary   # overrides default

where rho has replaced default in each case. Available lattice quantities include (using mode as an example):

4.2.1.2. Available fluid quantities for output

The following lattice-based quantities are relevant.

4.2.1.2.1. Fluid distribution output

The lattice Boltzmann distributions respond to the keys:

dist_io_mode              mpiio    # overrides default_io_mode
dist_io_format            binary   # overrides default_io_format
dist_io_report            yes      # overrides default_io_report

The resulting file names begin with dist, and their size is proportional to the number of distributions in the lattice Boltzmann model.

4.2.1.2.2. Fluid density output

For the fluid density, the keys are as above:

rho_io_mode               mpiio    # overrides default_io_mode
rho_io_format             binary   # overrides default_io_format
rho_io_report             yes      # overrides default_io_report

The density is scalar field with file names starting in rho-.

4.2.1.2.3. Fluid velocity output

The hydrodynamic velcoity field is available via:

vel_io_mode               mpiio    # overrides default_io_mode
vel_io_format             binary   # overrides default_io_format
vel_io_report             yes      # overrides default_io_report

This is a vector \((u_x, u_y, u_z)\) at each lattice site and files are prefixed vel-.

4.2.1.2.4. Scalar order parameter output

For free energies where there is a composition variable \(\phi\) use:

phi_io_mode               mpiio    # overrides default_io_mode
phi_io_format             binary   # overrides default_io_format
phi_io_report             yes      # overrides default_io_report

Corresponding files srat with phi-.

4.2.1.2.5. Tensor order parameter output

For liquid crystal problems use:

q_io_mode                 mpiio    # overrides default_io_mode
q_io_format               binary   # overrides default_io_format
q_io_report               yes      # overrides default_io_report

Corresponding files start with q-.

4.2.1.2.6. Electrokinetic quantity output

Electrokinetic quantities are controlled by the single key

psi_io_mode               mpiio    # overrides default_io_mode
psi_io_format             binary   # overrides default_io_format
psi_io_report             yes      # overrides default_io_report

Two sets of files will be produced. The first is a scalar field which is the electric potential with files named psi-. The second is a vector of charge densities (always positive) with files name qsi- (the name rho being reserved for the fluid density).

4.2.1.3. Frequency of I/O

The frequency of output for particular quantities can be controlled by, e.g., for fluid density

rho_io_freq    100     # Output every 100 time steps

If this key does not appear, no output will occur (other than required for full confiuration/restart; see below). The frequency must not be negative; if the frequency is set to zero, this is interpreted as “never”. Frequency is not relevant for input.

Note there is no default frequency. Frequecies for different lattice quantities should be set with the appropriate name, e.g.,

phi_io_freq    100     # Compositional order parameter
psi_io_freq    100     # Electrokinetic quantities

4.2.1.4. Configuration output

Fields required for configuration output - that required for restart - are determined internally by the code depending on the details of the simulation requested. The frequency of this output can be set via

freq_config    10000   # Full configuration output for restart

Full configuration output includes the lattice Boltzmann distributions, the density and velocity fields, and order parameters as required. The density and velocity fields are required in addition to the lattice Boltzmann distributions to ensure reproducibility at restarts. If isothermal fluctuations are present, the state of the lattice random number generator is also saved to file to take part in restart.

If a configuration output step co-incides with a “normal” output step for a particular quantity, output only occurs once.

If a full configuration is not required at the end of the run, one can set

config_at_end          no      # default is "yes"

The default is that configuration output should be produced at the end.

4.2.1.5. Meta data and data file names

Requests for file output will always create a relevant metadata file for the type of output requested. For example, a request for order parameter output will generate a single JSON file

phi-metadata.001-001

which contains information on the system size, order parameter fields and so on. The meta-data file provides a description of the corresponding data and is useful for post-processing.

Actual data appear in a separate file for each time step (at the frequency requested), e.g.,

phi-000000000.001-001
phi-000020000.001-001

would be expected for a simulation starting at time step zero, and producing output at each 20,000 steps. The file extension .001-001 indicates this is one file in a set of one.

4.2.1.6. Multiple file output

For the largest systems (probably larger than \(512^3\)) run on very large numbers of MPI tasks, it may be favourable to ask for output to be written to more than one file. This allows a larger overall bandwidth to disk to be obtained. The downside is that the separate files must be recombined if a complete view is required for visualisation etc.

Output (and input) to more than one file is requested by specifying an I/O grid. This decomposes the system in a similar way to the processor decomposition (with one or more MPI tasks per I/O grid group).

The I/O grid is set via

default_io_grid 2_2_1

which would result is four I/O groups writing to four separate files, e.g.,

phi-000020000.001-004
phi-000020000.002-004
phi-000020000.003-004
phi-000020000.004-004

with corresponding metadata files. The metadata files will detail which portions of the complete system are held by the respective data files.

4.2.2. File Data Formats

4.2.2.1. Data format

Output can be requested in either ASCII or (raw) binary format. While ASCII output can be appropriate for initial investigations, it is recommended that binary format is used. The data is always stored as 8-byte floating point in binary format. In ASCII there are usually 15 decimal places of precision.

4.2.2.2. Serial storage order

In serial (or with one MPI task with multiple threads), output occurs to a single file. Data for fluid quantities are written to file on a per-lattice site basis in the following order:

x_1 y_1 z_1   q_1 q_2 ...
x_1 y_1 z_2   q_1 q_2 ...
...
x_1 y_1 z_N   ...
x_1 y_2 z_1   ...
...

Files written in parallel automatically follow this order.

4.2.3. Older-style I/O mode

The “ansi” I/O mechanism was removed at Revision 0.22.0 in favour of the MPI/IO mechanism as the default. Serial files written with the old mechanism can be read by the MPI/IO mechanism.