unknown error while processing the markdown tokens.md
JamieShip opened this issue · comments
Problem
https://solana.com/zh/docs/core/tokens
unknown error while processing the markdown content.
Proposed Solution
![image](https://private-user-images.githubusercontent.com/109888946/335931939-cf12c3eb-3a8f-4ef5-a5a7-ba6612fe4981.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjEyMTc5MzksIm5iZiI6MTcyMTIxNzYzOSwicGF0aCI6Ii8xMDk4ODg5NDYvMzM1OTMxOTM5LWNmMTJjM2ViLTNhOGYtNGVmNS1hNWE3LWJhNjYxMmZlNDk4MS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzE3JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcxN1QxMjAwMzlaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hZjgwM2QzNTM2NWY5Y2ZmNjhkYzk2NjQxNDJhYjQ1ZGY2NzFhNzg4MWUzZDNjNmRlZDQxODY1Yjg4MjkxZGM2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.zhXGl2KM55cj2lt-F2jkA2QYagGsyEPhqJoSme_uAWk)
I will look into this. The odd thing to me is that the content of this document does not appear to have translations to this language and yet it is breaking.....
@JamieShip thanks for flagging this! I just push an update to solana.com that fixes this (and should prevent it in the future)
In a nutshell, our content translation platform Crowdin was altering the content of the markdown files to a point where our MDX parser would fail to parse them correctly due to some badly formatted content that Crowdin would return to us.
I improved that parser error handling, pre-parsing logic, and even added a more helpful error (with a direct link to create an issue) should something like this happen again :)