Giters

Viir / bots

Programming bots to play video games

Home Page:https://botlab.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problem with message box using bot 7aec4c539e (Eve Online Mining)

focabr opened this issue · comments

commented

Msg bot...

I see a message box to close.

I see no way to close this message box.

I am stuck here and need help to continue.

play-session-2023-01-14T02-17-05-at-1829037-ms-summary.json.txt

commented

Thank you for sharing this finding 👍
Using your screenshot, I can adapt the bot. Probably next week.
Until the new bot is ready, you could change the game client settings to not show this message box. The appearance seems to depend on the configuration of the game client.

commented

thanks for your reply, as a workaround I increased bot-step-delay=2500, after that the message does not get to appear.

commented

I have added bot b21ae94ac8 to fix this issue: fa2597f

You can run the new bot from https://catalog.botlab.org/b21ae94ac8

In the screenshot you posted, there is a button with a label 'OK'. You can close the message box by clicking on it.
The problem you saw happened because the representation of the 'OK' label is different from earlier observations. The bot was not anymore able to read the label because of these differences.
The linked commit adapts the reading of the buttons in message boxes to adapt to the new appearance in the game client.
The mining bot example already has a branch to click on a button if it is labeled 'OK' or 'Close' in a message box. So no changes were needed in selecting the next action in the Bot.elm module.

Along with the reading of the buttons, the commit introduces more of the framework for image-processing bots into the examples for EVE Online.

Background for bot developers

We introduced image processing functionality in bots more than a year ago. In EVE Online, bots have been using screenshots, for example, to check the status of ship modules.
The update in January 2023 improves the functionality for image processing the BotLab client substantially. Most importantly, new functionality in the development tools helps automate more of the bot development process. The development tools now show the images and crops read by the bot in the session history. The graphical interface also offers the export of individual images, making training data collection easier.

commented

I see you added information about a play session.
That play session did not use the new bot.

To use the new bot, select 'b21ae94ac8' in the 'Select Bot' view.

If you are not sure which bot you have selected, you can look in the BotLab client anytime. The selected bot is displayed both in the 'Configure Session' and in the 'Play Session' view while the bot is running.

Maybe the bot that you used there is very similar to b21ae94ac8. In that case, send me the recording of the session.

The session recording contains the relevant information, so I can use that to check what went wrong.
You can send the session recording to support@botlab.org 👍

commented

Some background information regarding the recordings and training data: The last image that you posted was derived from a memory reading. That is the kind of reading that already existed earlier and does not even contain the image data that we now use to read the labels on the buttons in the message boxes.
A session recording typically contains thousands of exportable images. Picking the right one for a given case sometimes takes some experience. That is why the recommendation for most people is to upload the complete recording. Then a developer can do the work of selecting the right part.
In this case, the most important image is in the 'Read from window' section of the event details view:
image

However, in this case, the overall development process uses the complete session recording to compose the test environment.

commented

Hi, thanks for replying.

I was using a version of the BOT that is in beta, I had updated the eve-online-mining-bot to version 2023-01-21 before running the bot.

I sent the session recording files by email.

commented

I sent the session recording files by email.

Thank you, I received the session-recording-2023-01-22T15-12-11.zip and will work with that.

commented

I fixed a bug in the framework which caused the bot to not detect the 'OK' label on the button: 6c35f63

commented

Viih,
I did the tests using 2 game clients with different themes and it worked very well.

Thanks a lot and good job.

commented

Thank you for the thorough testing 👍