Do not remove all loguru handlers before configuring clive ones

Instead only remove stream handlers (which are added by
test-tools via helpy).

Do it noly when appropriate flag was given, so in tests we
will have all tt.logger logs, but in production TUI, we won't
break it with stdout/stderr logs.