Search results

I assume non-secured urls are redirected to https, then it doesn't matter anymore. Same for non-www. Then you can add sitemap, check what Google Bot (or why not Bing, they have their own platform?) says about an url. Once these small details are clarified, investigate at the server level.

Thanks! sorry for delay, but I had a bad day. It seems it has all that's required for a decent crawler. Post it somewhere, and who knows, me or one of my clients will make the purchase if sales goes up. Are you a professional coder, or learned on your own?

Yes, I would have a look, thanks! But if it's indeed more performant than LS Crawler, maybe you can have a deal with LS team, so your work can have a better reward.

Ahh, I forgot my server uses mechanical HDD, which increase time response. Maybe in your setup Object Caching doesn't matter much. But in my tests, it decreased preload time from 55 minutes, to 47 (1700 urls). That was opencart crawler, less performance.

Now I recalculated and it seems in WordPress I can preload even 10k urls / hour at full load with PHP8 and Memcached. But I ignored the VPS I manage is still on MySQL 5.7, and it seems MySQL 8 has 2x more speed. What version do you have for PHP/ MySQL? Do you also use Object Caching? That...

I will have a look at features, but buying it's another story. Few clients I have, momentarily are happy with free tools, therefore must choose accordingly ;)

This is not a surprise, it is ~2013. I am curious about your plugin, if you can share one way or another.

For 100k urls/hour it can't be the usual hosting with hundreds/thousands of shared accounts. My VPS has 4 core and 5 shared accounts. It's configured so each account cronjobs never overlap with others. In one hour it can preload not more than 5k urls.

For WordPress I used Wp Super Preload. For other sites, not limited to WP, from same author there is Preload ByCron. Still, it must be configured and tested. @serpent_driver Great idea with broken links plugin, thanks. Never crossed my mind.

Hard to tell without having all information. I would check also error logs, there is one in public_html, other in wp-admin. For a change give it a try with php7.4 /php8.

This is just a part of a default message. Better copy all html code and paste it in Text Mode in WpEditor. Then switch to Visual to understand what's relevant about that error. What is your php version, and do you use an admin panel? There are various settings for admin side.

Do you have a control panel? Both cPanel or Cyberpanel can make it easier, at least for the daemon. But if php extension is installed with LiteSpeed compiler, it is indeed more complicated. Maybe their tutorial can help more. https://docs.litespeedtech.com/lscache/lscwp/admin/#how-to-debug

Sorry! I am too tired an had a wrong interpretation of my own quoted text Then Guest Mode it's not what I expected it to be.

I am sorry but you are both wrong. My understanding is that Guest Mode is for public/ non-logged in visitors. For first visit of a recently updated page, or one that its cache expired, they can still load fast an old cached page. Next public visitor will load the the updated cached page...

I think there are many features and options from WordPress LS Cache Plugin, that could be used also for OC cache extension. One is Guest Mode. It could help an underprovisioned hosting account, deal with a large number of pages. There is no hurry anymore to preload pages fast, read why below.

Be sure they also enabled crawler at the server level, or else need to ask for it.

Maybe there is info you can find in error log - there are 3 files. Be sure it's enabled in shop settings. Data about your installation as I said in the beginning? Mai poti îmbunătăți comunicarea.

Yes, it happened I browsed only cached pages. Maybe it's missing opcode caching, or the php version is old.

Have you checked the main site? It"s loading just fine. The problem is the sitemap, and the same we wait to load it, also does the server. One mistake is that a site should have only one enabled. Therefore, disable the first one, and then take it from there.

At this moment sitemap it's not loading. Maybe you will receive better help with details like OC version, php, and what are you using to generate sitemap - the SEO extension? It could be something wrong in the .htaccess. EDIT It finally loaded after 1 minute or even more, but without any...