I just went through a month long process to upgrade Hindupedia's Debian and Mediawiki from an ancient version installed 5 years ago (Debian) and Mediawiki 1.16.5 to the current version.
This was necessitated by Rackspace forcing me to upgrade our underlying virtual server (from the original virtual server to their "next gen server") which caused Hindupedia to constantly crash. A problem that took them 3 weeks to diagnose!
The new server at Rackspace has very poor performance as compared to the original server (which I found out after the new site went live)...I have had to upgrade to a higher-performance server but the site performs worse than the old one...requiring lots of additional optimizations. I would move off of Rackspace if it wasn't so time consuming to do so...
Below are my raw notes and links to helpful sites I found along the way from the migration.
This was necessitated by Rackspace forcing me to upgrade our underlying virtual server (from the original virtual server to their "next gen server") which caused Hindupedia to constantly crash. A problem that took them 3 weeks to diagnose!
The new server at Rackspace has very poor performance as compared to the original server (which I found out after the new site went live)...I have had to upgrade to a higher-performance server but the site performs worse than the old one...requiring lots of additional optimizations. I would move off of Rackspace if it wasn't so time consuming to do so...
Below are my raw notes and links to helpful sites I found along the way from the migration.
Restrict account creation -- "Autoconfirmed accounts"
Optimize MySQL: https://github.com/major/MySQLTuner-perl
http://haydenjames.io/mysql-query-cache-size-performance/
Optimize Apache: http://apache2buddy.pl/
Spam cleanup: http://webmasters.stackexchange.com/questions/9194/mass-deletion-of-spam-revisions-in-mediawiki/87775#87775
Defragment tables: http://stackoverflow.com/questions/26514073/mysql-defragment-innodb-tables
Optimize mediawiki: http://techwelkin.com/slow-mediawiki-optimize-to-enhance-performance-part-1
Configure security: http://www.rackspace.com/knowledge_center/article/configuring-basic-security-0
COnfigure iptables: http://www.gethackingsecurity.com/lockdown-ubuntu-2/
Apache caching for mediawiki: https://testbit.eu/using-mod_disk_cache-with-mediawiki/
Check page header: wget -S --delete-after -nd http://www.hindupedia.com/en/Main_Page
Memcache instructions: http://wiki.theplaz.com/Memcached_on_1and1_with_MediaWiki
{
##mods-enabled/mpm_prefork.conf
StartServers 15
MinSpareServers 2
MaxSpareServers 31
MaxRequestWorkers 31
MaxConnectionsPerChild 10000
##apache2.conf
<IfModule mpm_prefork_module>
StartServers 15
MinSpareServers 2
MaxSpareServers 31
MaxClients 31
MaxRequestsPerChild 10000
</IfModule>
}
{
PageTools.php Line 80
$user = $this->getSkinTemplate()->getSkin()->getUser();
if ( $user->isLoggedIn() ) {
} else {
}
}
LinkTitles
{
don't add links in templates
doesn't recognize diacritical marks on characters
}
Extra space above title:
.p-contentnavigation {
display:none
}
Google Site Search extn: https://www.mediawiki.org/wiki/Extension:GoogleCustomWikiSearch
Last modified date: https://www.mediawiki.org/wiki/Manual:Footer
<component type="Html"><![CDATA[<div class="socialWrap">
<div class="twitter_follow_us">
<a name="Follow on Twitter" href="http://www.twitter.com/Hindupedia" title="Follow on Twitter"><img rip-style-borderwidth-backup="" rip-style-borderstyle-backup="" style="" rip-style-bordercolor-backup="" src="/eng/images/follow_on_twitter_icon.png" alt="Follow on Twitter" height="22"></a>
</div>
<div class="addthis_sharing_toolbox1 addthis_toolbox addthis_default_style"></div>
</div>]]></component>
MAGIC WORD issues: https://gerrit.wikimedia.org/r/#/c/107259/1/includes/MagicWord.php
{ Server setup script
#!/bin/bash
IP="166.78.121.59"
cd /var/www/www.hindupedia.com
echo `pwd`
rm -rf hindupedia.sql* htdocs.1112015 htdocs_* htdocs.bak* htdocs.mediawiki.1.25 htdocs.new htdocs.tar root.dir.tgz /var/www/www.hindupedia.com/logs/* /var/www/www.hindupedia.com/htdocs/eng/StartProfiler.php &
apt-get install -y php5-dev php-pear libcurl3-openssl-dev php5-intl libicu52 icu-devtools libicu-dev php-apc imagemagick
yes '' | pear install pear
yes '' | pecl install intl
pear install MAIL Net_SMTP
echo "extension=raphf.so,propro.so,intl.so" >> /etc/php5/apache2/php.ini
sed -i "s/\<VirtualHost.*:80\>/VirtualHost $IP:80/" /etc/apache2/sites-available/www.hindupedia.com.conf
wget releases.wikimedia.org/mediawiki/1.25/mediawiki-1.25.3.tar.gz
scp root@www.hindupedia.com:~/LocalSettings.php /var/www/www.hindupedia.com/htdocs/eng/.
/etc/init.d/apache2 restart
tar -xvzf mediawiki-1.25.3.tar.gz
cp -rf mediawiki-1.25.3/* htdocs/eng/.
yes '' | pecl install pecl_raphf pecl_http
http://www.hindupedia.org/eng/mw-config/
http://www.hindupedia.org/eng/mw-config/
map q O###KKM update incompatible###^[j^i#^[:w^M
}
fix upload security: https://www.mediawiki.org/wiki/Manual:Security#Upload_security
PECL: http://www.mkfoster.com/2009/01/04/how-to-install-a-php-pecl-extensionmodule-on-ubuntu/
http://www.gossamer-threads.com/lists/wiki/mediawiki/
Skin: Foreground ( http://foreground.thingelstad.com/wiki/Main_Page )
Extension: LinkTitles ( https://www.mediawiki.org/wiki/Extension:LinkTitles )
Extension: DynamicPageList (3rd party) ( https://www.mediawiki.org/wiki/Extension:DynamicPageList_%28third-party%29 )
cpan CPAN App::cpanminus --installdeps
cpanm MediaWiki::Bot --installdeps
cpanm MediaWiki::Bot
cpanm Data::Dumper::Simple
cpanm MediaWiki::API
[roothp6:/var/www/www.hindupedia.com/htdocs/eng/extensions]$ rm -rf DynamicPageList simplefeed rss BreadCrumbs
Import dump:
{ Chameleon skin
Skin: Chameleon ( https://www.mediawiki.org/wiki/Skin:Chameleon )
* To Install
cd /var/www/www.hindupedia.com/htdocs/eng
curl -sS https://getcomposer.org/installer | php
mv composer.phar /usr/local/bin/composer
php /usr/local/bin/composer update
php /usr/local/bin/composer require mediawiki/chameleon-skin "1.*"
apt-get install git node npm
curl -sL https://deb.nodesource.com/setup_4.x | sudo -E bash -
sudo apt-get install -y nodejs
sudo apt-get install -y build-essential
add '$wgDefaultSkin='chameleon';' in LocalSettings.php
* To install theme 'United'
http://bootswatch.com/help/
cd /var/www/www.hindupedia.com
git clone https://github.com/thomaspark/bootswatch.git
npm install -g grunt-cli
npm install
apt-get autoremove
https://www.mediawiki.org/wiki/Skin_talk:Chameleon
}
{ Extension: ColList
List extensions: https://www.mediawiki.org/wiki/Category:List_extensions
https://www.mediawiki.org/wiki/Extension:ColList ## is bad...
https://www.mediawiki.org/wiki/Extension:Sort2
}
pear list # verify Net_SMTP OK.
Autolink extension: LinkTitles
Fix bug: https://github.com/bovender/LinkTitles/issues/5 (change "/u" to "/" in line 227 in LinkTitles.body.php
DynamicPageList extension:
(Main page tag)
<dpl>
namespace=Quotes
category=Sagely Quotes
include=*
includemaxlength=450
escapelinks=false
randomcount=1
reset=categories
addpagecounter=true
mode=userformat
resultsheader=__NOTOC__ __NOEDITSECTION__
listseparators={{mp-topicheader-h3|Sagely Quote}}\n
</dpl>
*** But need to fix table width dynamically resizing ***
*** Need to enable page history
i.e., http://www.hindupedia.org/eng/index.php?title=Main_Page&curid=1&action=history
http://stackoverflow.com/questions/3513773/change-mysql-default-character-set-to-utf-8-in-my-cnf
http://alvinalexander.com/blog/post/mysql/list-tables-in-mysql-database
{ PHPMyAdmin for SQL
apt-get install phpmyadmin (for pre-requisites)
wget https://files.phpmyadmin.net/phpMyAdmin/4.5.1/phpMyAdmin-4.5.1-all-languages.tar.gz
http://wiki.phpmyadmin.net/pma/Setup
}
{ SQL
mysql -u root -p <pw>
set names utf8;
show tables;
SHOW TABLE STATUS;
SHOW TABLE STATUS WHERE `NAME` LIKE '%page%';
show variables like 'char%';
show variables like 'collation%';
SHOW COLUMNS FROM page;
select page_id,page_title from page where page_title like 'Adhik%';
show index in page;
ALTER TABLE page MODIFY page_title VARCHAR(255) CHARACTER SET utf8;
http://product.hubspot.com/bid/7049/MySQL-and-Unicode-Three-Gotchas
-----PAGE TABLE STATUS BEFORE UPGRADE-----
mysql> SHOW TABLE STATUS WHERE `NAME` LIKE '%page%';
+-------------------+--------+---------+------------+-------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-----------------+----------+----------------+---------+
| Name | Engine | Version | Row_format | Rows | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time | Update_time | Check_time | Collation | Checksum | Create_options | Comment |
+-------------------+--------+---------+------------+-------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-----------------+----------+----------------+---------+
| page | InnoDB | 10 | Compact | 12461 | 127 | 1589248 | 0 | 2162688 | 11534336 | 14232 | 2015-11-01 10:40:06 | NULL | NULL | utf8_general_ci | NULL | | |
| page_props | InnoDB | 10 | Compact | 0 | 0 | 16384 | 0 | 0 | 11534336 | NULL | 2015-11-01 10:40:07 | NULL | NULL | utf8_general_ci | NULL | | |
| page_restrictions | InnoDB | 10 | Compact | 2 | 8192 | 16384 | 0 | 65536 | 11534336 | 3 | 2015-11-01 10:40:07 | NULL | NULL | utf8_general_ci | NULL | | |
| pagelinks | InnoDB | 10 | Compact | 28377 | 56 | 1589248 | 0 | 1589248 | 11534336 | NULL | 2015-11-01 10:40:07 | NULL | NULL | utf8_general_ci | NULL | | |
+-------------------+--------+---------+------------+-------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-----------------+----------+----------------+---------+
mysql> SHOW COLUMNS FROM page;
+-------------------+---------------------+------+-----+----------------+----------------+
| Field | Type | Null | Key | Default | Extra |
+-------------------+---------------------+------+-----+----------------+----------------+
| page_id | int(10) unsigned | NO | PRI | NULL | auto_increment |
| page_namespace | int(11) | NO | MUL | NULL | |
| page_title | varchar(255) | NO | | NULL | |
| page_restrictions | tinyblob | NO | | NULL | |
| page_counter | bigint(20) unsigned | NO | | 0 | |
| page_is_redirect | tinyint(3) unsigned | NO | | 0 | |
| page_is_new | tinyint(3) unsigned | NO | | 0 | |
| page_random | double unsigned | NO | MUL | NULL | |
| page_touched | binary(14) | NO | | | |
| page_latest | int(10) unsigned | NO | | NULL | |
| page_len | int(10) unsigned | NO | MUL | NULL | |
+-------------------+---------------------+------+-----+----------------+----------------+
mysql> select page_id,page_title from page where page_title like 'Adhik%';
+---------+----------------------------+
| page_id | page_title |
+---------+----------------------------+
| 11974 | Adhikamasa |
| 11975 | Adhikamasa,_adhimasa |
| 7128 | AdhikamÄÂsa |
| 6658 | AdhikamÄÂsa,_adhimÄÂsa |
| 11977 | Adhikara |
| 11978 | Adhikara_Nandi |
| 11976 | Adhikarana |
| 6660 | Adhikaraṇa |
| 6659 | AdhikÄÂra |
| 6661 | AdhikÄÂra_Nandi |
| 7126 | AdhikamÄÂsa,_adhimÄÂsa |
| 7117 | Adhikaraṇa |
| 7125 | AdhikÄÂra |
| 7118 | AdhikÄÂra_Nandi |
+---------+----------------------------+
-----PAGE TABLE STATUS AFTER UPGRADE-----
+-------------------+--------+---------+------------+-------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-----------------+----------+----------------+---------+
| Name | Engine | Version | Row_format | Rows | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time | Update_time | Check_time | Collation | Checksum | Create_options | Comment |
+-------------------+--------+---------+------------+-------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-----------------+----------+----------------+---------+
| page | InnoDB | 10 | Compact | 11883 | 133 | 1589248 | 0 | 2162688 | 111149056 | 14232 | 2015-11-01 10:40:06 | NULL | NULL | utf8_general_ci | NULL | | |
| page_props | InnoDB | 10 | Compact | 0 | 0 | 16384 | 0 | 0 | 111149056 | NULL | 2015-11-01 10:40:07 | NULL | NULL | utf8_general_ci | NULL | | |
| page_restrictions | InnoDB | 10 | Compact | 2 | 8192 | 16384 | 0 | 65536 | 111149056 | 3 | 2015-11-01 10:40:07 | NULL | NULL | utf8_general_ci | NULL | | |
| pagelinks | InnoDB | 10 | Compact | 28765 | 55 | 1589248 | 0 | 1589248 | 111149056 | NULL | 2015-11-01 10:40:07 | NULL | NULL | utf8_general_ci | NULL | | |
+-------------------+--------+---------+------------+-------+----------------+-------------+-----------------+--------------+-----------+----------------+---------------------+-------------+------------+-----------------+----------+----------------+---------+
mysql> select page_id,page_title from page where page_title like 'Adhik%';
+---------+----------------------------+
| page_id | page_title |
+---------+----------------------------+
| 11974 | Adhikamasa |
| 11975 | Adhikamasa,_adhimasa |
| 7128 | AdhikamÄÂsa |
| 6658 | AdhikamÄÂsa,_adhimÄÂsa |
| 11977 | Adhikara |
| 11978 | Adhikara_Nandi |
| 11976 | Adhikarana |
| 6660 | Adhikaraṇa |
| 6659 | AdhikÄÂra |
| 6661 | AdhikÄÂra_Nandi |
| 7126 | AdhikamÄÂsa,_adhimÄÂsa |
| 7117 | Adhikaraṇa |
| 7125 | AdhikÄÂra |
| 7118 | AdhikÄÂra_Nandi |
+---------+----------------------------+
}
// vim: ts=2:sw=2:noet:comments^=\:///
