We have this issue on 4.1 SP1 Patch 8, so I think it was even earlier that you think. When we removed the 12,000 row report tab, keeping the 3,000 row tabs, it was much faster. Perhaps the APS that renders the report in Excel runs into memory issues and needs its memory bumped up to handle larger rows?
Jon