Ocular contamination of EEG data is an important and very common problem in the diagnosis of neurobiological events. An effective approach is proposed in this paper to remove ocular artifacts from the raw EEG recording. First, it conducts the blind source separation on the raw EEG recording by the stationary subspace analysis, which can concentrate artifacts in fewer components than the representative blind source separation methods. Next, to recover the neural information that has leaked into the artifactual components, the adaptive signal decomposition technique EMD is applied to denoise the components. Finally, the artifact-only components are projected back to be subtracted from EEG signals to get the clean EEG data. The experimental results on both the artificially contaminated EEG data and publicly available real EEG data have demonstrated the effectiveness of the proposed method, in particular for the cases where limited number of electrodes are used for the recording, as well as when the artifact contaminated signal is highly non-stationary and the underlying sources cannot be assumed to be independent or uncorrelated.