The LCI 323i comes with iDrive. My personal view is go for the 325i Sports (am biased as I have the pre-LCI 325i Sports) since:
1. Both engines are 2.5L, you pay the same roadtax, but the 325 has a higher level of tune -> more power & torque
2. Always hated wood trim. 325i has sportier trim
3. Better cornering/handling
4. Sportier/more aggressive look
5. You will get used to the harder ride. I use it as a daily ride, as long as you take due care by avoiding potholes, slowing down for speed bumps (which you would be doing for the 323i anyway), you will get used to it, and before long you will enjoy the handling.