Yeah, I have kited out to Egmont from Big Beach a couple times (so have Jay and Billy). I also use to windsurf out to there from BB a lot if NW.

It's sort of neat, I guess. I would recommend taking a boat out though, and rigging and riding it then.
Longest swim of my life was 6/7 years ago riding out to Egmont when I had an equipment failure. The currents out there in the channel and the surrounding areas can be nasty as hell if the tide is running good.

I don't think it's worth the hassle of going out there just to ride it. It's just not that special, imo.
The beach is narrow in most places, it's a long ride out... etc. I can think of better places to go for that kind of effort.