PyMonSchema

Another free MongoDB schema analyser based on PyMongo and wxPython. Fast and Effective by using MongoDB MapReduce to analyse collection schema, simple yet powerful.

Author: HanseyLee

Screeshot

Usage

Using Python 3.

$ pip install -r requirements.txt
$ python pyMonSchema.py

Also, you can package it as a executive program using pyinstaller.

After starting, two steps for operation:

First:

Several required fields:

- Fill MongoDB uri and click Connect button to connect MongoDB deployment. MongoDB uri, refer to https://docs.mongodb.com/manual/reference/connection-string .
- Fill database name and collection name to switch to specific collection.

Second:

After connect and switch to specific collection, there are several optional fields before analyse schema.

Query -> MongoDB query document to filter input to analyse. e.g. {"keyName": {"$in": ["key1", "key2"]}}, {"keyName": {"$exists": True}}(Note: PyMonSchema use Python Method "eval()" to deserialize query string, so use 'True'/'False' if query string contains bool value)
Order -> Positive/Negative, used in sort document, order=Positive equivalent to sort("_id":1), order=Negative equivalent to sort("_id":-1).
Limit -> Int, limit value of query result. Empty default is 0, which means no limit.
Omit_keys -> Fields string to be omitted, sperate by comma. such as: keyName1, keyName2 .
Omit_patterns -> Fileds match these regular expression patterns will be omitted, sperate by comma. such as: ^keyNameHead, keyNameTail$ .
Embed-keys -> Whether to analyse embed-key (e.g. keyNameParent.keyNameChild1.keyNameChild2) or not.
Analyse -> Run analyse.

Output:

Display schema result.

Save button -> save the result as a json file named databaseName_collectionName-Schema.json default. The output json file like this:

[
    {
        "key": "_id",
        "total_occurrence": 15.0,
        "statics": [
            {
                "type": "ObjectId",
                "occurrence": 15.0,
                "percent": 100.0
            }
        ]
    },
    {
        "key": "hello",
        "total_occurrence": 9.0,
        "statics": [
            {
                "type": "Int32",
                "occurrence": 1.0,
                "percent": 6.666666666666667
            },
            {
                "type": "String",
                "occurrence": 8.0,
                "percent": 53.333333333333336
            }
        ]
    },
    ...
]

Contribution

welcome to contribute your code to improve this poor tool :P

HanseyLee / pyMonSchema