Of course, first make sure You have the regular kernel installed
# yum install kernel
then either remove the PAE kernel (yum erase kernel-PAE) or simply pick the non-PAE kernel to boot. To boot non-PAE kernel edit the /etc/grub.conf and point the "default=X" to non-pae kernel. The first kernel line is denoted with default=0, second default=1 and so on.
Mind, that PAE is required to support more than 4GB of ram(I believe).