It sounds like the significant contributor was that you were flying at night without a whole lot of night experience. (Yes, I acknowledge that you said your instructor said you did great flying at night and you were night current and I believe you). Now, as more than half of my 800 hours (non-commercial) were flown at night, let me share some things that, hopefully, will help.
Let me just say that I am still not totally comfortable flying at night, especially VFR, even though I do it.
I always take a more careful look at the weather, definitely the forecasts (FA, TAFs, etc.). And it doesn't matter whether or not it's a local flight. I always study the terrain along my planned route, no matter how many times I've flown it. If I leave the airport area, I always plan my flight with waypoints (that I can see at night), headings, etc. on a flight planner. (And, yes, all the VORs, etc. - no, I don't have GPS, unfortunately).
When I started to earnestly fly at night, I did it because it was easier for superficial reasons: the scheduling was easier, there is less traffic, it was after work, almost no deadline to get back as no one scheduled the plane after me, no sun in my eyes, etc. etc.
But I didn't just go somewhere far. I was nervous about it so I just stayed in the pattern. I think my first dozen or so flights were just in the pattern at Hayward (HWD). Then I got a little braver, so I flew south a few miles and flew back. I did this a few times as well. Until I was sure I can find my way back in the dark (plus being close in case the fog came in), I flew to Palo Alto (PAO) and came back. Yep, I did this quite a few times too. Then for the longest time, I just flew to Palo Alto, San Carlos (SQL), and back to Hayward. I learned what the "landscape" looked like at night. I knew what all the bridges looked like at night. I noticed all the lighted towers on the hillsides (there are quite a few). I figured out the best way to find the rotating beacons (just be patient). I recognized what the major freeways looked like. I learned how it looked during a clear night under a full moon. I learned what it looked like without a moon. I learned how the horizon looked during periods of unlimited visibility. Also with fog obscuring the distance. And, what I consider the hardest...how to taxi around an airport in the darkness. And, just as important, I learned how to read my panel at night (especially the altimeter), how to use lighting, how to read charts, etc.
Finally, after a year of doing this, I tried a Bay tour at night.
You get the idea. I invested quite a few hours learning the night landscape and how to fly in it. So, when I take a trip (even to socal - although I go on an IFR plan), at night, I am reasonably comfortable (I didn't say totally) navigating it. (I've got to tell you, though...to me, day VFR is "nothing").
Anyway, don't give up. Just don't think of night flying as being the same as day flying. Take the time to learn how to fly it. Learn how things look like at night. It need not be a arduous as what I've done (I'm a big chicken). One step at a time. You'll do much better next time.
