May I ask you for how to start this project?

Question

May I ask you for how to start this project?

Arashiailing opened this issue 2 years ago · comments

I had read your paper Learning Intrusion Prevention Policies through Optimal Stopping, and have some problems,such as the defender policy against NOISYATTACKER and STEALTHYATTACKER, I don't know how it works. And your code import gym_pycr_ctf but I can't find this function

Kim Hammar · Answer 1 · Wed Nov 16 2022 21:48:01 GMT+0800 (China Standard Time)

Hi @Arashiailing.

Unfortunately this project is not actively updated. I plan to release the latest code base for the extended version of the paper (see https://ieeexplore.ieee.org/document/9779345) soon.

If you just want to get started with reinforcement learning and cyber security, I recommend: https://github.com/Limmen/gym-idsgame

Arashiailing · Answer 2 · Wed Nov 16 2022 23:38:47 GMT+0800 (China Standard Time)

Thanks for you reply, I'm learning gym-idsgame now. Your'code are very professional and I learned a lot. I hope someday I will be a man like you, and finally have a good day!

…

---Original--- From: "Kim ***@***.***> Date: Wed, Nov 16, 2022 21:48 PM To: ***@***.***>; Cc: ***@***.******@***.***>; Subject: Re: [Limmen/gym-optimal-intrusion-response] May I ask you for how tostart this project? (Issue #2) Hi @Arashiailing. Unfortunately this project is not actively updated. I plan to release the latest code base for the extended version of the paper (see https://ieeexplore.ieee.org/document/9779345) soon. If you just want to get started with reinforcement learning and cyber security, I recommend: https://github.com/Limmen/gym-idsgame — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

ybello02 · Answer 3 · Thu May 04 2023 05:56:51 GMT+0800 (China Standard Time)

Hi Kim,

I'm trying to work on your csle framework (https://limmen.dev/csle/) that was recently made public for one of my research work. It seems I can't git clone the framework. Just wondering if I'm doing anything wrong from the installation guide or the source code of the framework is not yet made public.

Thanks a lot. I really appreciate your work.

Kim Hammar · Answer 4 · Thu May 04 2023 14:25:09 GMT+0800 (China Standard Time)

Hi @ybello02,

Thanks for your interest in CSLE. The framework is currently in a beta release, going through some tests. We will soon release the code to the public, I will let you know.

Best/Kim

ybello02 · Answer 5 · Thu May 04 2023 18:33:47 GMT+0800 (China Standard Time)

Hi Kim,Thank you for your quick response. I will keep an eye on the release of csle.A quick question, can I use the traces you provided from the emulation environment to run the gym-optimal-intrusion-response game environment. I clone the code but when I run the runner.py, it keeps throwng back errors of missing modules (gym_cfr) from gym.Best,Yahuza.On May 4, 2023, at 2:25 AM, Kim Hammar ***@***.***> wrote: Hi @ybello02, Thanks for your interest in CSLE. The framework is currently in a beta release, going through some tests. We will soon release the code to the public, I will let you know. Best/Kim —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>

Kim Hammar · Answer 6 · Thu May 04 2023 18:46:40 GMT+0800 (China Standard Time)

You are welcome. This repository is not actively maintained, I think it is not much work to fix the issues it seems just to be about some library conflicts but I won't keep this library up-to-date.

You can use this library instead, it is based on the same publication and I just tested it and it works: https://github.com/Limmen/optimal_stopping_pomdp

To use it, run the following commands:

git clone https://github.com/Limmen/optimal_stopping_pomdp
cd optimal_stopping_pomdp
pip install -e .
cd examples
python ppo.py

BR/
Kim

ybello02 · Answer 7 · Thu May 04 2023 18:52:07 GMT+0800 (China Standard Time)

Thank you very much Kim. I really appreciate it. I will try the suggested library.Best,Yahuza.On May 4, 2023, at 6:46 AM, Kim Hammar ***@***.***> wrote: You are welcome. This repository is not actively maintained, I think it is not much work to fix the issues it seems just to be about some library conflicts but I won't keep this library up-to-date. You can use this library instead, it is based on the same publication and I just tested it and it works: https://github.com/Limmen/optimal_stopping_pomdp To use it, run the following commands: git clone https://github.com/Limmen/optimal_stopping_pomdp cd optimal_stopping_pomdp pip install -e . cd examples python ppo.py BR/ Kim —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>

ybello02 · Answer 8 · Thu May 04 2023 21:06:30 GMT+0800 (China Standard Time)

Hi Kim, Thanks for the suggestion. I run the optimal stopping game and it works using the PPO. After it finishes running, it does not save the results in the .zip file that it was supposed to. Do I have to specify the save dir in the ppo.py code for that? Thanks for your help. Best, Yahuza.

…

On Thu, May 4, 2023 at 6:52 AM Yahuza Bello ***@***.***> wrote: Thank you very much Kim. I really appreciate it. I will try the suggested library. Best, Yahuza. On May 4, 2023, at 6:46 AM, Kim Hammar ***@***.***> wrote: You are welcome. This repository is not actively maintained, I think it is not much work to fix the issues it seems just to be about some library conflicts but I won't keep this library up-to-date. You can use this library instead, it is based on the same publication and I just tested it and it works: https://github.com/Limmen/optimal_stopping_pomdp <https://www.google.com/url?q=https://github.com/Limmen/optimal_stopping_pomdp&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3BW9oJkwbzHBvhFtA5viyM> To use it, run the following commands: git clone https://github.com/Limmen/optimal_stopping_pomdp <https://www.google.com/url?q=https://github.com/Limmen/optimal_stopping_pomdp&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3BW9oJkwbzHBvhFtA5viyM> cd optimal_stopping_pomdp pip install -e . cd examples python ppo.py BR/ Kim — Reply to this email directly, view it on GitHub <https://www.google.com/url?q=https://github.com/Limmen/gym-optimal-intrusion-response/issues/2%23issuecomment-1534537526&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3Gmy4IX8qeiGe8uqIC63hw>, or unsubscribe <https://www.google.com/url?q=https://github.com/notifications/unsubscribe-auth/ANNLB6DRPWO4756PJXVLAKTXEOCJZANCNFSM6AAAAAAR7PO354&source=gmail-imap&ust=1683802013000000&usg=AOvVaw3G26TC1ytOpBZhg-vrcW3Z> . You are receiving this because you were mentioned.Message ID: ***@***.***>

Kim Hammar · Answer 9 · Thu May 04 2023 23:08:15 GMT+0800 (China Standard Time)

Documentation for PPO is available here: https://stable-baselines3.readthedocs.io/en/master/

Best,

Kim

ybello02 · Answer 10 · Thu May 04 2023 23:28:48 GMT+0800 (China Standard Time)

Thanks for your feedback. Appreciated it.Best,Yahuza.On May 4, 2023, at 11:08 AM, Kim Hammar ***@***.***> wrote: Documentation for PPO is available here: https://stable-baselines3.readthedocs.io/en/master/ Best, Kim —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>