Switched to using cuda streams again. Full advantage only comes if a custom version of NvPipe is (optionally) install: https://github.com/knicos/NvPipe
Further work could be done to increase advantages of streams by adding more streams in ILW and render.