I don‘t know enough about Linux, but based on what we have seen, I believe the issue is down to the memory & swapping. E.g Arm boxes OK, OScam version is OK, SoftcamManager version does not change situation - its current OpenViX version that raises the issue.
When Oscam is started from the SoftcamManager it runs under the Enigma2 “address space“ (my terms) which is being paged to swap (because it is largest user), when Oscam is started via the script it is running under a different address space and either because of its priority or the size of its “address space“ (number of pages in use) is not being swapped - and there is no performance hit.