Mailing list 100,000 and up

[BGSWebDesign]

Dean,

Most servers do not time out in the middle of sending.  
Your host may have a restriction on PHP script loading which would still be reached even with the upcoming background sending option.

I don't believe this is the case, as sometimes it can complete all the way through the mailing without showing the RESUME option, how could that be if the problem were related to PHP script loading?  

Also, I use SMTP server mailing (reconnect every 2500 emails), not PHP, is that part of the problem, should I set RECONNECT every 2500 emails to a lower number, say 500?

[chufford]

I was loosing messages a while back. I found that my server only allowed 1000 messages per connection. I changed the "reconnect" setting to 999 and that made all the messages work.

There are some other interesting optimizations discussed at
http://listmailpro.com/forum/index.php?topic=49.0

[KB]

Hi Guys

I've just seen some of your queries about where I host. I've mailed my own server guys to see if they want more mailing business.They will respond shortly - if they are happy I'll post their details.

Regards

Kevin

[BGSWebDesign]

Hi Kevin,

Thanks, I'd like to know if they are available, to have an option for emailing larger lists with a host that knows how LMP works  

Keep us posted please...

[KB]

Hi guys.

I have been in contact with the guy who hosts my listmail stuff. He provides a dedicated server that never falls over and gives me between 500 and 600k a day. Also helped me move my stuff from ev1
My server runs $300 a month
He's happy to talk with you - phoned me in South Africa to answer some of my questions. Has reverse dns so so you can whitelist at aol. If you want his details then mail me at bauer@mweb.co.za with your details and I'll pass them on.

Regards

Kevin
ps. He does have smaller systems so maybe they would be suitable for smaller lists

[neil]

I don't have a list anywhere close to those numbers, but I can't even send out to 5000 a day on H4P.

What I do have is my own server for website hosting, so I'll be moving from H4P ASAP.  What is the best way to move my subscribers?

I have a lot of space and bandwidth to offer for a GREAT fee, for LMP owners only.  If you will send me a PM and tell me what you are looking for, I will reply with my Special LMP Price.

Neil

[dane]

Dean,

Is the throttling code still recommended int he newest version of LM to assist in the sending of lists larger than 10K?

Please provide as much detail as possible regarding when and if the code should be used.

Thanks,

Dane

Most servers do not time out in the middle of sending.  Your host may have a restriction on PHP script loading which would still be reached even with the upcoming background sending option.  A dedicated server should handle over 720,000 messages per day so even a shared host (configured correctly) with 10-20 users should be ok.

[DW]

Dane,

I don't recall why this was done but I do not recommend throttling code be implemented with SMTP.  I have not found it to be necessary at all.  If your list is over 25,000 or so I recommend that you ask your host to make sure the server is optimized so your messages do not slow down the server.  (I would also reassure them that you run a very professional list). You can already delay "internal PHP mail" if you use that for your list email.

[DW]

Neil,

The best way to move your subscribers - in fact, your entire ListMail database, is through PhpMyAdmin. Do an "Export" of all of your tables with the "Complete Inserts" option enabled. Save it to your local computer and re-import it into a new database on the new host via PhpMyAdmin or the command-line.

Regards

[dane]

Dean,

Are there any special set-up features to run larger lists, 10K - 250K in size?

Thanks,

Dane

You should be able to achieve at least 750,000 messages per day but yes, your server can be bogged down.  Performance with very large lists is still being tweaked to prevent this.  I will likely have to rewrite bounce.cgi to be a complete Perl solution, as opposed to passing data to a URL, to offer better performance.  This might mean 2 config files.  config.php and config.pl.  I believe this is where a lot of the problems occur.  I am also considering that there may be MySQL processes that don't die or are increasingly using more memory.

[DW]

I have experience with qMail (Plesk) and Exim (cPanel, Ensim) and have posted a few optimizations for these mailers.  Your server administrator could make use of what is mentioned in these posts.  You may want to forward the information to them.

There is one further optimization that may not be in effect on your installation: Try adding an index on the id field of the lm_sendq table with PhpMyAdmin.

Regards

[andrew]

Great topic.
Good input from all.

Our primary list topped 405K this week. Big. Very big.
I also just moved to a new server w/Cpanel- so great timing DW with
the LMP import fix.

It seems like everyone's working pretty hard to manage the bigger lists, between throttling, primary key fixes (maybe from another post), running on two machines...

We're not very technical, so we needed a clean, simple solution. Knowing that we've run successfulyl with lists in the 30-40K range, I decided to take our master list and split it by 50K each, done alphabetically with Mailloop's listp processor, and catalogued alphabetically to keep track of where we were within the database.

So far so good. Looking at it now we sitting at 2.11 emails per second on the first list. I plan to queue them up seperately and run each list individually.

Just wanted to share what we've done, thought I would sure be interested in any easy to implement solutions to tweak, modify or seriously expedite things to reach the 10-12K per-hour mark.

Thanks for all your input.

Andrew

[Stefaans]

There is one further optimization that may not be in effect on your installation: Try adding an index on the id field of the lm_sendq table with PhpMyAdmin.

My apologies for resurrecting an old thread, but I need clarification.

I am using ListMailPro version 1.87. Looking at the lm_senq table, it seems like there is already a primary key for the id column set up. So, do I take it to be optimized already?

[DW]

Stefaans,

Yes, that's right.

Regards