ExpressionEngine CMS
Open, Free, Amazing

Thread

This is an archived forum and the content is probably no longer relevant, but is provided here for posterity.

The active forums are here.

A very big MySQL base loading when more than 60000 entries

October 09, 2010 8:12am

Subscribe [5]
  • #1 / Oct 09, 2010 8:12am

    24here

    69 posts

    I have a site and there was lot of entries on it, more than 60000, because I used an RSS imported news.

    So I didn’t catch that moment when site began produce a very big loadnig on MySQL base, but I’m shure that happened because when more entries, the more loading.
    Even though I have 20 visitors on site, the site create a big loanding of MySQL base.
    You can say that this loading could be because we using 3rd modules, NO.

    When I have deleted about 55000 entries and them became the order 5000 loading has considerably decreased, even several times.

    So could you please tell, how I can protect a site from the big loading with magnification of an amount of news in due course? Whether probably to make, that loading didn’t depend on an amount of news?

    Thanks

  • #2 / Oct 10, 2010 1:47pm

    Greg Salt

    3988 posts

    Hi 24here,

    Much is going to depend on your server environment and to a large extent on how you have set EE up and how your templates are structured. The Wiki has a page on Optimising EE and you should make sure and read the Data Caching & Performance part of the user guide.

    Cheers

    Greg

  • #3 / Oct 10, 2010 4:35pm

    24here

    69 posts

    thanks, I read this Wiki’s page and cached all of a could. The problem is not in caching. The problem came when I have very many entries, for example 60000 entries on site.
    I forgot to say, I used EE 1.6.8

  • #4 / Oct 11, 2010 3:14pm

    Ingmar

    29245 posts

    So what’s the actual problem? If you have lots of entries you will also need a performant server to keep up with the load. Regular pruning is probably your best option in the long term. That said, do take a look at the link on server optimization and performance that Greg provided, they can help, too.

  • #5 / Oct 11, 2010 3:27pm

    Lisa Wess

    20502 posts

    I just wanted to step in here - 60,000 entries is not that many.  There are EE sites with hundreds of thousands of entries.  What will impact speed is server environment, concurrent users, and how you setup your templates.

  • #6 / Oct 11, 2010 4:09pm

    24here

    69 posts

    Sorry, I didn’t understand your question.

  • #7 / Oct 12, 2010 10:53am

    Sue Crocker

    26054 posts

    24here, Ingmar and Lisa are both saying that 60,000 entries isn’t that big of a database. Many sites have that many. The difference is in how the site is set up, how much memory is allocated to PHP, that sort of thing.

    But again, what is the exact problem? Slowdown? Nothing showing on the front end? What exactly?

  • #8 / Oct 12, 2010 11:14am

    24here

    69 posts

    slowdown, error 504.

    Here is config of VPS:
    HDD 10000Mb
    CPU 800MHz
    RAM 512

    You can say: “buy a new hosting with more modern hardware”. But where is guaranties that when I buy a new hardware I will not have a problem when the numer of entries will 120 000 or 240 000.

    So, I want to say that loading related to the number of entries. The more records, the more loading.
    When I cut a lot of entries and leave only about 5000, I’ve got a fast site )

    There are not an external factors!!! Not caching, not number of visitors, not number of MySQL queries per page.

    The questions is: why loading depends on number of entries?

  • #9 / Oct 13, 2010 2:56am

    John Henry Donovan

    12339 posts

    24here,

    We weren’t suggesting you buy new hosting and new hardware. What we are saying is you may well need to optimize what you have at the moment. Take a look at these Performance Guidelines. There is some info there regarding optimizing your database.

    An error 504 is a server error. Was there more to the error. Can you paste exactly what it was here in a reply please?

    Is this a Windows VPS?

    What are you doing in the control panel when this error appears or is it just on the front end?

    How much memory is allocated to PHP. Look for memory_limit in your PHP Info
    CP Home ›  Admin ›  Utilities ›  PHP Info

    Do you have any extensions running?

.(JavaScript must be enabled to view this email address)

ExpressionEngine News!

#eecms, #events, #releases