There are many things that can be going wrong. I have to say I'm not sure what you were sorting in the top panel, because less than 50% purity of T cells by flow cytometry is not 'Good'.
Some things to consider:
Some cell-surface molecules are prone to capping, CD3 is one of them. You can prevent this by keeping the cells cold and using about 0.01-0.05% sodium azide in your buffer used to stain, wash and sort the cells.
Any problem in the setup of the FACS can lead to poor purity. For instance if your drop delay is incorrect to start with or changes during the sort, then you'll get poor purity.
Make sure the flow process is being watched. A small temporary clog can send all the wrong cells in your tubes (and affect drop delay).
As for magnetic sorting, make sure you are using the correct ratio of beads to cells.
I'm not sure how you are staining or-restaining the magnetically isolated cells, but make sure your not blocking the
antibody you use for the final analysis by the presence of unconjugated
antibody used to isolate the cells.
It is also worth remembering that your problems may not just be one thing and that a couple of small independent issues may be affecting your results.