pixelcmtd / 73Tools

The tools we use to create datasets from Seventythree Schuladmin and run big data analyzes of them.

73Tools

a bunch of old tools to deal with Seventythree's log files

• lib73: shared code, can be used to deal with 73XML and 73DB files
• 73LogToDb: creates a 73DB file from all arguments
• 73LogToXml: creates a 73XML file from all arguments
• 73XmlTimeSort: sorts the 73XML file from the first argument by time
• 73XmlToNames: gets a list of all action names from a 73XML file

Documentation

Log naming

The raw logs are always about 1 MiB big. Their names are always in the following format:

$"SADLog bis {mm}-{dd}-{yyyy} {hh}-{mm}-{ss}.txt"

except the newest one, which is not finished and called SADLog.txt.

Line syntax

Almost every line of log is one event in the following format:

$"{dd}.{mm}.{yyyy}	{hh}:{mm}:{ss}	{action} in {caller}	{tokens}	{error}"

(yes, these are actual tabulators)

Known action names

• StartProgram
• OnReceive
• NachrichtBehandeln
• Senden
• SetNTFSBerechtigungen
• AddNewSession
• Error
• RemoveSession
• MainSAD
• CheckBasisserver
• ConnectDB
• IsPC (exception to the normal line syntax)
• GetMandant
• GetServerName
• LesePfade
• SALMVerbinden
• NachrichtSenden
• NachrichtErhalten
• UnbeaufsichtigterModus
• In (this might only exist due to a parsing error)
• GetClientIPAddress

Custom formats

73XML

The 73XML-Format is a notation of 73-logs which is designed to be both valid XML and human readable.
Encoding a single line in C# looks like this:

$"<sad><line name=\"{name}\" caller=\"{caller}\" tokens=\"{tokens}\" error=\"{error}\" /></sad>"

73DB

The 73DataBase-Format is a Deflate wrapper around line objects.
The sequentially saved line objects look like this:

struct line
{
	uint8_t  name_length; //byte count
	utf8     name[name_length];
	uint8_t  caller_length; //byte count
	utf8     caller[caller_length];
	int64_t  timestamp; //little endian
	uint16_t token_length; //little endian
	utf8     tokens;
	int32_t  error; //little endian
}

The line objects are all just appended and compressed with Deflate.