Author Topic: My list is about 100,000, how can I speed it up.  (Read 18403 times)

paul

  • Posts: 41
    • View Profile
My list is about 100,000, how can I speed it up.
« on: June 14, 2004, 11:05:08 am »
I'm using Cpanel.  They just came out with a new version that slowed down the delivery rate, but it has a new security patch, so I have to keep it.  

I have a list of about 100,000 prior to the upgrade it would take 24 hours (4-5K delivered per hour) to send out to the list totally.  Now it takes about 4-5 days (1-2K delivered per hour).  Any idea how I can speed this up?  Please help?

I love listmailpro.  I've been using it for a two years and loving it!  

Thanks,

Paul

DW

  • Administrator
  • Posts: 3787
    • View Profile
    • https://legacy.listmailpro.com
My list is about 100,000, how can I speed it up.
« Reply #1 on: June 14, 2004, 09:26:14 pm »
Paul,

100,000 in 24 hours is quite slow in itself.  Your now 4-5 day delivery time is simply unbearable.

CPanel in its default configuration (prior to upgrade?) should have accepted all of your emails in a reasonable amount of time.   Something like a maximum of 3 hours to send 100,000 messages to the server would be a generous estimate.  After that, it's up to the SMTP software (Exim, in CPanel's case) to deliver each message in queue.

It's possible that your host is running a very large number of users on the server who are also sending out email or making extensive use of MySQL.  This is the most common cause of delays.

Unfortunately, there is no way for me to know what the CPanel upgrade did - I will have to look into it.  I have a large number of clients on CPanel and have access to a dedicated server running the software, too, so I should be able to come up with a solution if the slowdown is indeed caused by the upgrade.

Another thing known to slowdown mailings to larger lists is lack of a Primary Key on the "id" field of the lm_sendq table.

With PhpMyAdmin, which is more than likely accessible from your control panel, open up the lm_sendq table and hit the button next to the "id" field that shows "Primary Key".

This change is usually only necessary on much larger lists but could help somewhat in your case.  It will be implemented automatically on all installations in the next update.

I will see what I can determine with the admin access I have to a CPanel dedicated server.  On second thought, though, we have applied a patch to Exim and prevented it from being updated during CPanel updates so it's hard to say if I will be able to reproduce these results.  :?
Dean Wiebe
ListMailPRO Author & Developer - Help | Support | Hosting

paul

  • Posts: 41
    • View Profile
phpmyadmin
« Reply #2 on: June 16, 2004, 02:42:19 am »
I made the change, I hope it helps.  I'll let you know after I send next newsletter.

Thanks,

Paul

DW

  • Administrator
  • Posts: 3787
    • View Profile
    • https://legacy.listmailpro.com
My list is about 100,000, how can I speed it up.
« Reply #3 on: April 25, 2005, 10:11:21 pm »
It's been a long time since this post has been visited but I was just browsing around and read it again.  I thought I'd reply to hear how you made out.

Did your mailing speed improve?

Regards
Dean Wiebe
ListMailPRO Author & Developer - Help | Support | Hosting

paul

  • Posts: 41
    • View Profile
Upgrade helped.
« Reply #4 on: April 26, 2005, 01:36:25 am »
Upgrading to 1.8 helped. It cut the delivery time in about half.

neil

  • Posts: 13
    • View Profile
    • http://www.MultipleStreamsOfProfit.com
My list is about 100,000, how can I speed it up.
« Reply #5 on: April 26, 2005, 04:19:44 am »
I am on a dedicated server with CPanel and currently there is no
one else on it.

Which works better for the configuration, PhpMyAdmin or MySQL?

I am getting ready to install 1.8 on my server, and from what I've read
so far it looks like PhpMyAdmin is the way to go.

I'll keep checking back until I am actually running the config to see if
there is a winner.

Thanks,

Neil
CONQUER the Internet! GRAB your piece of the Internet pie!
Why settle for reading about how others are making it big
online? When you decide it's YOUR TURN,
I’ll reimburse your $24.95 Fast Track Fee!
http://www.MultipleStreamsOfProfit.com/empower.html

DW

  • Administrator
  • Posts: 3787
    • View Profile
    • https://legacy.listmailpro.com
My list is about 100,000, how can I speed it up.
« Reply #6 on: April 26, 2005, 02:08:35 pm »
PhpMyAdmin is more reliable for transferring a v1.7 installation onto a new server with v1.8.  If already installed, you will want to remove your v1.8 tables before importing your v1.7 ones.  Once the old database is running on the new files, re-login to ListMail (and be patient) for database changes to take effect.

Regards
Dean Wiebe
ListMailPRO Author & Developer - Help | Support | Hosting

idealizm

  • Posts: 13
    • View Profile
My list is about 100,000, how can I speed it up.
« Reply #7 on: June 21, 2007, 02:35:50 pm »
Did anyone else notice a major decline in delivery speed again with the latest Cpanel upgrade?  Just like the original post, I logged in and saw that my support team upgraded my dedicated box with a newer Cpanel upgrade, and, of course, things have slowed quite a bit.

paul

  • Posts: 41
    • View Profile
I can second that...
« Reply #8 on: June 21, 2007, 03:38:35 pm »
With Cpanel 11, I have seen a 20% decline in speed of delivery.

paul

  • Posts: 41
    • View Profile
Sorry, Forgot to add.
« Reply #9 on: June 22, 2007, 07:26:42 pm »
I didn't see this decline in performance when I switched to CPanel 11.  I saw it after I switched to maildir mail box format from the old mbox.  Sorry, I just remembered.

DW

  • Administrator
  • Posts: 3787
    • View Profile
    • https://legacy.listmailpro.com
My list is about 100,000, how can I speed it up.
« Reply #10 on: June 23, 2007, 06:37:59 pm »
Things can slow down noticeably based on the size of the queue.  Hard drive access time with folders containing just a few thousand files is much, much slower. I think the mailbox format could have a lot to do with it.

If you notice things going more slowly I recommend checking the size of the mail queue.

http://bradthemad.org/tech/notes/exim_cheatsheet.php
Code: [Select]
exim -bpc
You might consider shortening the length of time messages are kept in queue.  Yahoo, for one, does rate-limiting that can cause severe bottlenecks.  If you notice this becoming a problem you might want to contact them.

http://listmailpro.com/forum/index.php?topic=1579.0

I also recommend these Exim configuration changes:

http://listmailpro.com/forum/index.php?topic=49.0

Regards
Dean Wiebe
ListMailPRO Author & Developer - Help | Support | Hosting

paul

  • Posts: 41
    • View Profile
Thanks Dean..
« Reply #11 on: June 24, 2007, 03:47:07 am »
Great input.  I have those configs. in place and I do find that Yahoo has been my big problem for about 2 months now. I have contacted them to little avail.

That exim config, works like a charm.

I will try contacting Yahoo again though.

1000 Thanks.