Well... I don't do twitch, but I make youtube videos...
We all seem to face a common issue with this. Which is, how do you get anyone to watch you? (A secondary issue which is also important, but comes up slightly later - how do you KEEP them watching?)
The first one seems to be the bigger problem when you're just starting.
Now, I don't know how twitch works, but on youtube it seems you have to spread the word that you even exist far and wide to have much hope.
I would guess twitch is similar, though you also run into the complication that you are doing something live, which means you not only have to direct people to watch you, but you have to make sure they do so at a time when you're actually doing something!
This is easier said than done, and I can't say I've had much luck over on the youtube side of things (though perhaps more than some, given I average about 20 views per video or so, and many struggle to even get that.)
First you might ask yourself what the problem actually is though...
Are you losing your audience AS you stream? If so, you may need to look at what you do while streaming.
More likely though, you aren't really getting any viewers in the first place. (which is usually the problem most face, starting out).
That is a completely different kind of problem, and has less to do with what your content is like, and generally more to do with exposure.
No matter how good or bad what you do is, people need to know you exist before they'll watch anything.
The quality of your work only factors into things AFTER you have already convinced someone to watch you in the first place...
Anyway, sorry I couldn't help much more than that...
Good luck.