Giters

wso2 / micro-integrator

The cloud-native configuration driven runtime that helps developers implement composite microservices.

Home Page:https://wso2.com/integration/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

File connector listFIles operation hangs up when listing around 6000 files

malakaganga opened this issue · comments

commented

t was observed that the File connector listFIles operation hangs up when listing around 6000 files from SFTP location. Each file size reach File connector version is 4.0.20. When debug logs are enabled for org.apache.commons.vfs we could see the connection hand shake is made and the below log is printed continuously for each file.

[2024-03-20 14:45:34,636] DEBUG {org.apache.commons.vfs2.cache.SoftRefFilesCache} - putFile: sftp://sftpczczc:***@9122/0024710240-1709809349726.xml

[2024-03-20 14:45:34,636] DEBUG {org.apache.commons.vfs2.cache.SoftRefFilesCache} - putFile: sftp://sftpczczc:***@9122/0024710240-1709809349726.xml

Due to this the integration is not progressing after the list files operation. In another round of execution 1330 files were processed correctly, but when processing 6000 this issue occurs.