that being said

话虽如此

The same as saying.... however, never the less, yet, on the other hand.

Usually it means that they are about to contradict what they just said, or follow up with some exception to what they just said. It implies that they wish to acknowledge that there is more than one side to an issue.

For example:
I think it is important for a couple to graduate from college and begin their careers before settling down and getting married. This helps prevent a feeling of regret or "nonfulfillment" later in life. That being said, I would be OK if my daughter were married straight out of college without starting her career.