ODF Specification Tooling

Overview

The purpose of this project is to provide:

Automated tooling for the deliverables of the OASIS ODF TC foremost for its specification and grammar.
Test documents according to the new ODF features provided by the specification.

The project aligns to the standard directory layout of a Maven build system.

We are using GitHub pages - our docs directory - to store our latest HTML & default value transformations:

Latest ODF 1.4 artifacts	Latest ODF 1.3 artifacts	Latest ODF 1.2 artifacts
ODF 1.4 Intro HTML	ODF 1.3 Intro HTML	ODF 1.2 Intro HTML
ODF 1.4 Packages HTML	ODF 1.3 Packages HTML	ODF 1.2 Packages HTML
ODF 1.4 Schema HTML	ODF 1.3 Schema HTML	ODF 1.2 Schema HTML
ODF 1.4 Formula HTML	ODF 1.3 Formula HTML	ODF 1.2 Formula HTML
ODF 1.4 Attribute Default Values	ODF 1.3 Attribute Default Values	ODF 1.2 Attribute Default Values

Automated Tests

For the usage of the test environment have installed:

Java JDK - tested with JDK 11.
Apache Maven

Building & Running (Linux & Windows)

All tests are triggered from command line:

cd odf-tc
mvn clean install

Default Value Extraction (not yet a test)

It's first automated test will be the extraction of default values from ODF 1.2, an enhanced ODF 1.2 version, ODF 1.3 and the most recent enhanced ODF 1.3 version with default values.

There had been three fixes on the ODF 1.2 specification being made by adding a character style to the default values making them extractable again on:

@form:echo-char for value "" see "The default value for this attribute is "" (U+002A, ASTERISK)." compare the definition beyond form:enctype.
@smil:fadeColor for value value "#000000"
@style:leader-text for value value " " (Space)

The complete list of ODF default values

for ODF 1.2 can be found here or in the [ODF Toolkit](https://github.com/tdf/odftoolkit/blob/1.0.0_SNAPSHOT/odfdom/src/codegen/resources/config.xml#L218.
for ODF 1.3 can be found here
for ODF 1.4 (not yet created)

The most recent & stable SAXON XSLT processing engine will be used to extract the default values.

Default values can now be extracted from ODF 1.4 part 3 via:

mvn install -Pdefault

NOTE: All XSLT output will be written into the directory: target/generated-resources/xml/xslt. To be able to easily compare the new result with the prior, there is a bash script to copy these output files to resources/odf1.4/references/xslt-default and do an XML indent using xmllint.

RelaxNG HTML (not yet a test)

The RelaxNG schemas can be transformed via XSLT to HTML, enriched with hyperlinks between the different named patterns and syntax highlighting.

mvn install -Prng

ODF2HTML transformation (not yet automated regression tests)

The transformation of the ODT specifications from ODF to HTML is being done via the LibreOffice (LO) XSL transformation.

The XSLT source have been duplicated here for some usability reasons:

To use the ODF2HTML XSLT filters as a stand-alone, out-of-the box running bundle
To allow our own regression tests - not using flat XML (as LO) but unzipped ODT test files
To allow our own modifications on-top (we are only adding a MathML Javascript by default as Chromium had a bad MathML support and we added MathML support for our formulas).
Using the most recent & stable SAXON XSLT processing engine to transform the documents into HTML.

But we are keeping the XSLT filter in synch!

NOTE: To get MathML handled properly, the XSLT must be run from LibreOffice; this is because the XSLT requires the MathML to be inline which is only offered by the provide flat ODT (single XML stream/file) and only LibreOffice supports this Flat ODT currently. Therefore the stand-alone XSLT via Maven can only be used for testing. But the advantage is that there is no "noise" of changed names during reloading in LO the ODT during testing. The ODF 1.4 parts can be transformed via maven too (this is aly the default if no profile is specified):

Using the ODF2HTML Test

Start ODF2HTML XSLT tests by calling on Linux ./xslt-regression-test.sh
The HTML XSLT output (from ./target) will be compared via diff with a reference file from resources/odf1.4/references/xslt-html.

Adding a ODF2HTML Test

New test files have to be added as ODT and similar named unzipped folder in src/test/resources/html-export/input
Add the name of the test document in []./xslt-regression-test.sh](https://github.com/oasis-tcs/odf-tc/blob/master/xslt-regression-test.sh#L7)
When the output HTML works as expected copy it to the reference folder src/test/resources/odf1.4/references/xslt-html

Editor Workflow & Tools

Our Git repository is containing the ODF TC deliverables in the GitHub directories:

src/main/resources/odf1.2
src/main/resources/odf1.3
src/main/resources/odf1.4

Within the above folders the TC deliverables are saved under the following restrictions:

Ordered in a single flat directory hierarchy. They might be still delivered by OASIS in various directories later to the users.
Their file names will not contain the usual OASIS state abbreviation within the file names (e.g. OS). Versioning is being done by using GIT tags instead.
ODT specification documents are for ease of use duplicated as:
1. ODT files - being zipped XML files & pictures
2. Unpacked directory named as the document with the suffix '.' exchanged as '_'

To unzip and zip the ODT we are offering following tools:

java -cp target/test-classes org.oasis_open.odf_tc.Unzip src/main/resources/odf1.3/OpenDocument-v1.3-part1-introduction.odt
java -cp target/test-classes org.oasis_open.odf_tc.Zip   src/main/resources/odf1.3/OpenDocument-v1.3-part1-introduction.odt

These tools are available after being build by:

mvn install

As mentioned before the directory is used aside the ODT file with ".odt" replaced by "_odt". In the future, providing a new ODT should trigger an automated process:

Unzip the changed ODT & commit the unzipped ODT XML to GIT as well
Transform the changed ODT to HTML & commit the results beyond reference /docs/odf<VERSION>
In case of ODT schema - extract the default values & compare them with the reference beyond /docs/odf<VERSION>

ODF Editing Tool

LibreOffice paralell installation

Currently, LibreOffice 7.1.5 is being used to edit the ODT files by all editors in en-US. It might be helpful to install the Editor LibreOffice version in parallel with other LibreOffice (LO) installations to avoid automatic exchange (see LO documentation).

LibreOffice unique configuration

In addition, to the parallel installation the configuration should not be shared. As only one LO instance of one configuration can run at one time. This can be done manually after installation - likely before the first start - editing the file <LO_PATH>/program/bootstraprc (or <LO_PATH>/program/bootstrap.ini on Windows) and change the last line to:

    UserInstallation=$ORIGIN/..

NOTE: This places the usually shared configuration directory (since 7.5 called "user") into the LibreOffice installation directory (as a sibling of "program" directory).

LibreOffice pretty printing XML within ODT/ZIP

It's convenient for Git reviews to enable the XML pretty-printing in LibreOffice: go to "Tools-->Options...[-->LibreOffice]-->Advanced" Press on the "Open Expert Configuration" button. Search for "prettyprinting" and toggle it on, or alternatively add this line in registrymodifications.xcu in $ORIGIN/.config/libreoffice/4

NOTE: LibreOffice should not be opened during editing, otherwise it might overwrite the line when being closed.

<item oor:path="/org.openoffice.Office.Common/Save/Document"><prop oor:name="PrettyPrinting" oor:op="fuse"><value>true</value></prop></item>

LibreOffice XHTML XSLT export taking from our GitHub

In the LO menu go to "Tools-->Macros-->XML Filter Settings, in this window select the "XHTML Writer export filter", press "Edit" and choose the "Transformation" label. Exchange the existing "XSLT for export" from your
```
<LO_PATH>\program\..\share\xslt\export\xhtml\opendoc2xhtml.xsl
```
```
<GITHUB_ODF-TC_PATH>\src\test\resources\odf1.4\tools\odf2html\export\xhtml\opendoc2xhtml.xsl
```
NOTE:: You need to enable the checkbox "The filter needs XSLT 2.0 processor".
You need to select your Java installation used by the XHTML XSLT export via the menue: "Tools-->Options...-->Advanced". We suggest the long-term-support JDK 11 version, others should work.
You need to install the Saxon extension: xslt2-transformer.oxt. Just drag&drop the OXT file onto the menu bar of the new LibreOffice for TC editing

BEWARE: Double click on the OXT file might trigger the default LibreOffice, which is likely not the required for TC Editing. The missing extension will result into an endless transformation. You start testing the installation with the smaller ODF package specification.

After this you are able to create XHTML via: "File/Export...", select "XHTML (.html,.xhtml)", click "Export"

LibreOffice ODF Settings

In the LO menu go to "Tools-->Load & Save" and choose on the right side among "Default File Format and ODF Settings" as "ODF format version" "ODF 1.3".

Background

Members of the Open Document Format for Office Applications (OpenDocument) TC create and manage technical content in this TC GitHub repository as part of the TC's chartered work (the program of work and deliverables described in its charter.

OASIS TC GitHub repositories, as described in GitHub Repositories for OASIS TC Members' Chartered Work, are governed by the OASIS TC Process, IPR Policy, and other policies. While they make use of public GitHub repositories, these repositories are distinct from OASIS Open Repositories, which are used for development of open source licensed content.

Description

The purpose of this repository is to provide version control for developing the OpenDocument Format (ODF) file format and related tools beginning with ODF CS 1.3.

Contributions

As stated in this repository's CONTRIBUTING file, contributors to this repository must be Members of the OASIS OpenDocument TC for any substantive contributions or change requests. Anyone wishing to contribute to this GitHub project and participate in the TC's technical activity is invited to join as an OASIS TC Member. Public feedback is also accepted, subject to the terms of the OASIS Feedback License.

Licensing

Please see the LICENSE file for description of the license terms and OASIS policies applicable to the TC's work in this GitHub project. Content in this repository is intended to be part of the OpenDocument TC's permanent record of activity, visible and freely available for all to use, subject to applicable OASIS policies, as presented in the repository LICENSE.

Further Description of this Repository

Any narrative content may be provided here by the TC, for example, if the Members wish to provide an extended statement of purpose.

Contact

Please send questions or comments about OASIS TC GitHub repositories to the OASIS TC Administrator. For questions about content in this repository, please contact the TC Chair or Co-Chairs as listed on the the OpenDocument TC's home page.

oasis-tcs / odf-tc