I would do Cape Fear Regional Jetport (KSUT) at Oak Island NC. Just a short taxi to Southport where you can grab a ferry to Bald Head Island. Plenty of inlets to fish. Local charters and with small kids you're only an hours drive to Myrtle Beach (or a short flight) for all of the touristy things...