11.0.4 data sets

[simplebi_guy]

Anyone else finding the new datasets chewing up a ton of memory when created against big database tables.  We pulled in a table (a query subject from FM package to be more precise) with a million rows which was running very well in our reports but when we tried adding it to a data set it grabbed 4GB of ram from our server (on top of the 4 it was idling at) and wouldn't let go even after we deleted the dataset.  Had to restart to get that ram back.  Based on a clean install and repeatable, we are wondering if this is something others have noticed or something just in our environment.