I am now automatically capturing new list postings as they appear and auto-converting them to HTML pages with their formatting (indents, fonts, colors etc.) pretty well intact. This should result in much more readable posts and fewer artifacts. I'll note that converting raw mail files to HTML output like that is technically rather difficult as no general tools exist for that and the conversion is far from straightforward. It took quite a bit of coding effort, but I think it really paid off. Take a look at some of the most recent posts in the archives and compare them to the ones in your inbox and you'll see what I mean.

In addition, I am now able to upload those posts to the archives (with one click) as soon as they arrive in my mailbox. Or, if I have stuff that I'm working on at the moment or am out of town, I can elect to let them collect for a while before I batch process and upload them. But, in general, posts should appear in the archives no later than the end of each day.

I have not yet attempted to implement threading (and at this point I may never get around to it), although I did ensure that the necessary Message-ID headers are included in all new posts.

Finally, just for general information, the archive collection is automatically crawled by our search indexer each evening. So all posts should turn up on archive-wide search results within one day of being uploaded.

Rob Toreki