2008 Malibu LT 2.4 L Keyless Entry Help

Here is an odd one. Been searching forums and can't find any answers.
Here is what I have done.  New Lock Actuators  /  New Car battery  /  New
Genuine GM FOB and New FOB Battery - Programmed at a lock smith  /  
Bought the car used  /  The doors will lock and unlock with door button and
the trunk will open with the trunk button.
Here is the problem  /  I locked the car and go in side.  Come out later and
the key fob will not unlock the doors, truck will not open and the panic alarm
will not activate  /  Unlocked the door with the key and the alarm goes off  /  
Silence the alarm with the fob and the doors will unlock and lock with the fob.
Close the door and lock them with the fob. And then it repeats.
So I know the fob works and the door locks work with the fob. Not sure why
the trunk wont open with the fob. There are no codes showing up or check
engine lights. I have run an scan with obd 2 scanner and it shows nothing.