openSeaChest_Logs: FARM data in stdout

Question

openSeaChest_Logs: FARM data in stdout

yaarith opened this issue 3 years ago · comments

It would be nice if we can pipe the FARM data from openSeaChest_Logs to openSeaChest_LogParser and not go through a file on disk (i.e. openSeaChest_Logs --farm -o - | openSeaChest_LogParser ...).
Currently, the openSeaChest_Logs saves the data to a file. That takes a little logic to find what the file name is (need the serial number and the time the log was generated), it's more automation friendly to allow piping.

Tyler Erickson · Answer 1 · Thu Mar 17 2022 01:22:20 GMT+0800 (China Standard Time)

Hi @yaarith,
The current method is due to how we've interacted with different customers in the past and had binaries shared directly back to Seagate. This has been changing over time and we've begun parsing more in the log parser. They are separate processes due to requirements we've had from data centers in the past.
I think this is another good use-case to support though.
I'll check our project schedule to see where we can fit this in.

yaarith · Answer 2 · Fri Mar 25 2022 04:32:55 GMT+0800 (China Standard Time)

Thanks for clarifying, @vonericsen.
When can we expect this feature?

Tan · Answer 3 · Thu Mar 31 2022 04:02:43 GMT+0800 (China Standard Time)

Hi @yaarith,
It would take a few weeks.

Dan Mick · Answer 4 · Thu May 26 2022 03:57:18 GMT+0800 (China Standard Time)

Any progress? Seems like there could be one tool that either only saves the binary format or does the extra step of parsing/output, but is anyone looking into this?

Tan · Answer 5 · Fri May 27 2022 00:11:42 GMT+0800 (China Standard Time)

Hello @dmick,
We've started looking into it but it has been delayed due to other projects that we're working on in parallel. Hopefully, this should be ready for testing in a couple weeks.

Tan · Answer 6 · Thu Aug 25 2022 05:51:44 GMT+0800 (China Standard Time)

Hello @yaarith & @dmick,
I'm so sorry it took so long. We have had a lot of internal customer request. However, the new code has been pushed to the develop branch for both openSeaChest_Logs and openSeaChest_LogsParser. We also added a bash script for Linux in"example" folder.

Example:
./openSeaChest_Logs -d /dev/sdb --farm --logMode pipe | ./openSeaChest_LogParser_x86_64 --inputLog fromPipe --logType farmLog --printType json --outputLog testLog.jsn

yaarith · Answer 7 · Thu Aug 25 2022 23:26:45 GMT+0800 (China Standard Time)

Thanks for the update, @Rungthida.
I do not see these commits in either repos under the develop branch, when were they merged?

Tyler Erickson · Answer 8 · Fri Aug 26 2022 01:29:44 GMT+0800 (China Standard Time)

Hi @yaarith,
I have merged @Rungthida's code into develop. We had a miscommunication, but it is now on develop in both openSeaChest and openSeaChest_LogParser.
Let us know if you have any problem using this.

Tyler Erickson · Answer 9 · Thu Mar 02 2023 05:27:53 GMT+0800 (China Standard Time)

Closing this as the code has been in develop and has now been released in https://github.com/Seagate/openSeaChest/releases/tag/v23.03
Please feel free to reopen this issue or create a new issue if you need any other help!