shirohana / pypoe-parser

PyPoE Parser

Parse extracted large JSON file from PyPoE into parts.

Must to Know

At first, you must know what you're doing and how to use PyPoE, here's some useful links:

• OmegaK2/PyPoE
• PoE Wiki - PyPoE

This repo contains only tiny script which to parse large json into parts with specific structure, from:

data.json

[
  { "filename": "fileA.json", "header": {...}, "data": {...} },
  { "filename": "fileB.json", "header": {...}, "data": {...} },
  ...
]

to:

fileA.json

{ "filename": "fileA.json", "header": {...}, "data": {...} }

fileB.json

{ "filename": "fileB.json", "header": {...}, "data": {...} }

. The script is not related to PoE exactly (ﾉ∀`)

Btw, the use case seems really uncommon, no more document unless somebody asked.

Quick Start

1. Install

   git clone https://github.com/shirohana/pypoe-parser
   cd pypoe-parser
   yarn install

2. Usage

   Usage: parse-json [-m | --minimize] [-o <dir> | --output-dir=<dir>]
                     <target.json>

3. Extract full data as JSON format from PyPoE

   pypoe_extractor setup perform
   pypoe_extractor dat json data.json # data.json close to 288MB

4. # Extract hundreds JSON file to ./dist with human-readable JSON format
   ./bin/parse-json data.json
   
   # Minimized
   ./bin/parse-json -m data.json
   
   # Custom output directory
   ./bin/parse-json -m data.json -o ./another/dir

---

Remember the use-terms and policy of Grinding Gear Games and Path of Exile, be a good fan/gamer.