What is the power in the amp? Speakers shouldn't be the problem as most reports have those as very good, but the limited power of the OEM amps is probably holding things back. They are way under powered based on ratings you posted. The amp would just clip and sound bad when you pushed it. the recommendation is for driving speakers at 75%-150% the rates RMS power. There is no OEM pushing that many watts. Free air subs don't make a lot of sound for the power either. Pushing those just clips them.
2012 SXT V6/8SPD Sport Package (Rallye)
Performance: Rear Stabilizer/Mopar CAI/Quantum Blue/ACES IV/Tackified Red
Exterior: Mopar Caliper Covers/Mopar Chin Spoiler/Rear Spoiler
Interior: OEM Rearview Camera
JBL GTO3EZ/504 Amps /PAC Audio C2A-CHY5 HU Adapter/MiniDSP 2x4 Sound Processors
Infinity Reference 3032 Dash 3.5"
Infinity Reference 9632 Door/Rear Deck 6x9"
Infinity Reference 1062W 10" sealed sub