The Squad Wiki Pipeline (in short: "pipeline") allows the extraction of game data for the tactical first-person-shooter Squad by Offworld Industries. The data is extracted from the Squad SDK (not the game files!) and then uploaded to the Squad Wiki. All of this is performed by the pipeline semi-automatically.
This pipeline currently only extracts map layer and map vehicle assets data. See example map wiki page for the actual use of this data.
The pipeline consists of four components:
- Export the game data from the Squad SDK
- Convert this raw export into JSON format for easier processing
- Convert SDK labels into names used on the wiki
- Upload the data to Data pages on the wiki
Most of these steps create interim output files which are used as input files for the following step.
Step 1 exports the raw data from the Squad SDK.
Step 2 creates a file format that is easier to process the data in the following steps.
Before the SDK export can be uploaded to the wiki, naming convertions must be performed because the internal naming in the Squad SDK does often not match with the naming on the Squad Wiki - this is done in step 3.
With step 4 the data is uploaded to the wiki with the goal of making the data accessible in a Cargo database. However, there is no MediaWiki API to access the Cargo tables directly, therefore we have to upload the data into interim Data pages - from there, using Cargo commands, the data goes finally into the Cargo tables.
Cargo tables allow the automatic re-use of its data on many wiki pages. Therefore, we only have to update the Cargo data and all wiki pages are automatically updated with the latest data. The data is pulled from the Cargo tables using Scribunto. Scribunto allows powerful programming (using the programming language Lua) to manipulate and visualize the data onto wiki pages - everything done automatically.
If you want to learn more about the wiki-side programming and maintenance, see our Squad Wiki Cargo Maintenence documentation. Below documentation focuses exclusively on the first four steps that make up the pipeline.
You will find output files for all new Squad releases on GitHub in folder completed_output/. Feel free to use them for your own use with credit given to the Squad Wiki.
Documentation on how to install this pipeline can be read here
Documentation on how to configure this pipeline can be read here
Documentation on how to use this pipeline can be read here
Documentation about the output JSON file can be read here
You can find more documentation for the usage of the pipeline here - this documentation covers the practical operation of the pipline on the wiki-side.
We have developed this pipeline in 2020 for the maintenance of the Squad Wiki. We are utlizing the pipeline every time a new version of Squad is released. We are constantly improving the pipeline and make more and more use of the Cargo data on the wiki.
In the future we are considering extending the pipeline to extract more and more game data for the wiki.
Feel free to use this pipeline or parts of it for other games or game wikis.
If you want to contribute to the pipeline for the Squad Wiki, consider joining the team in the Squad Wiki Editorial.
The pipeline was created and is being operated by the team in the Squad Wiki Editorial for the Squad Wiki. You can best reach us on our own Discord.
Listed by Discord user names:
- Shanomac99#9407 - programming and operation
- Usgu#2705 - concept, coordination and documentation
- [RIP] Rosarch#1541 - contributor
This project would not have been possible without the invaluable help and support from Offworld Industries, especially the developers Virus.exe and FuzzHead.
This repository is under the Creative Commons Attribution-ShareAlike 4.0 International. See License.md.