Issues in data set generation of crop segmentation pipeline

[MuhammadHammadBashir]

I am working over dataset generation. Every thing including setup is fine.

When I try to create data using some region of interest using this line wf_run.monitor().

It shows this error, I also tested the internet connection etc is working perfectly.

File ~/Desktop/farmvibes/farmvibes-ai/myenv/lib/python3.10/site-packages/requests/adapters.py:501, in HTTPAdapter.send(self, request, stream, timeout, verify, cert, proxies)
    486     resp = conn.urlopen(
    487         method=request.method,
    488         url=url,
   (...)
    497         chunked=chunked,
    498     )
    500 except (ProtocolError, OSError) as err:
--> 501     raise ConnectionError(err, request=request)
    503 except MaxRetryError as e:
    504     if isinstance(e.reason, ConnectTimeoutError):
    505         # TODO: Remove this in 3.0.0: see #2811

ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

[Rafael Soares Padilha]

Hi, @MuhammadHammadBashir. Thank you for using FarmVibes and raising this issue.

It seems the client cannot connect to your local cluster. Please, could you check the status of the cluster by running farmvibes-ai local status in your terminal?

Additionally, could you provide the output of the following command: ~/.config/farmvibes-ai/kubectl get pods

Are you able to run the hello world notebook / workflow?

[Rafael Soares Padilha]

Hi, @MuhammadHammadBashir. Were you able to run the hello world notebook/workflow?

[Mohamed Elsawy]

Hi @rafaspadilha. I faced the same issue when running the 'data_ingestion/sentinel2/preprocess_s2' workflow. I had already tried the hello world workflow and it worked well, and the run.monitor() command worked well and the process completed successfully. Later I tried running the preprocess_s2 workflow and it was taking a really long time to download a single image from a total of 68 (it stayed on 0/68 for 30 minutes) so I tried cancelling the run but it didnt work. I then restarted the local cluster, and when I ran the .run() call it gave me the same issue as reported here. Here is the output of my "get pods" command:

NAME                                       READY   STATUS    RESTARTS   AGE
terravibes-worker-58f9876d47-f9kmh         0/2     Unknown   29         4d22h
terravibes-rest-api-86c9f76ccc-rms47       0/2     Unknown   22         4d22h
terravibes-data-ops-6d86cdd956-k5trp       0/2     Unknown   35         4d22h
terravibes-orchestrator-695774d6bd-xhbxp   0/2     Unknown   32         4d22h
terravibes-worker-58f9876d47-lmg4x         0/2     Unknown   30         4d22h
terravibes-cache-9486577db-dg7mc           0/2     Unknown   31         4d22h
terravibes-worker-58f9876d47-27b6n         0/2     Unknown   33         4d22h
rabbitmq-0                                 0/1     Unknown   7          4d22h
redis-master-0                             0/1     Unknown   6          4d22h

Any ideas why the status is UNKNOWN and how to fix this?

[Renato L. de F. Cunha]

This might indicate your storage is full. What's the output of df -h?

[Rafael Soares Padilha]

@moeelsawy, were you able to fix your issue? Did increasing your storage solve it?

@MuhammadHammadBashir, are you still facing this issue?

[Rafael Soares Padilha]

Closing this issue for now. Please, @moeelsawy and @MuhammadHammadBashir, feel free to reopen the issue if your problem persists.