mysql_online_migrations

mysql_online_migrations

Patch Rails migrations to enforce MySQL 5.6 online migrations Prior to MySQL 5.6, when adding / removing / renaming indexes and columns, MySQL would lock the writes of the whole table. MySQL 5.6 by default will try to apply the least locking possible. You however don't know what kind of locking it applies and there's situations where it can't allow writes during a migration (See Caveats). This gem enforces LOCK=NONE in all migration statements of Rails. Therefore, you're getting an error when MySQL cannot write during the migration so there's no surprise when rolling out in production.

Requirements

Built for Rails 3.2.15+, including Rails 4.

List of requirements :

• Use mysql2 adapter
• Use Rails ">= 3.2.15"
• Use MySQL or Percona Server 5.6.X with InnoDB

Scope of this gem

Patch Rails migrations to automatically add LOCK=NONE when issuing ALTER, CREATE INDEX, CREATE UNIQUE INDEX. DROP INDEX statements from any methods of ActiveRecord:

• Index management : add_index, remove_index, rename_index
• Add column : add_column, add_timestamps
• Remove column : remove_column, remove_timestamps
• Change column : change_column, change_column_null, change_column_default
• Any other method that was added in Rails 4 etc ...

Please note that it only modifies sql queries sent in Rails Migrations. This way we avoid patching all of ActiveRecord statements all the time.

Usage

In a typical Rails app, just add it to your Gemfile :

gem 'mysql_online_migrations'

Then run bundle install

You're ready for online migrations! Please read the caveats section though.

Turn it off for a whole environment

Example for environment test (your CI might not use MySQL 5.6 yet), add the following to config/environments/test.rb: config.active_record.mysql_online_migrations = false

Turn it off for a specific statement

Call your migration statement within with_lock method. Example :

with_lock do
  add_index :my_table, :my_field
end

The with_lock method will be useful when hitting the caveats of LOCK=NONE. Please read the 'Caveats' section.

Enable verbose output

To enable an 'ONLINE MIGRATION' debug statement whenever an online migration is run, simply set the MysqlOnlineMigrations.verbose module variable to true. Example (in a Rails app's config/initializers/mysql_online_migrations.rb):

MysqlOnlineMigrations.verbose = true

Caveats

The MySQL manual contains a list of which DDL statements can be run with LOCK=NONE under Table 14.5 Summary of Online Status for DDL Operations. The short version is that you can not yet:

• Index a column of type text
• Change the type of a column
• Change the length of a column
• Set a column to NOT NULL (at least not with the default SQL_MODE)
• Adding an AUTO_INCREMENT column,

If you don't use the with_lock method when online migration is not supported, you'll get a MySQL exception. No risk to lock the table by accident. It's therefore highly recommended to use it in development/test/staging environment before running migrations in production. If you have to perform such a migration without locking the table, tools such as pt-online-schema-change and LHM are viable options