Does about 5:30 work for you? It may be dark by the time that we start to head back, though the sunset over the open ocean is a sight to behold and I'm quite capable of navigating by moonlight.
If you'd rather we return while it's still light out, however, I would certainly not be opposed to setting out earlier.