Control Your Database Infrastructure
Severalnines
 

New Webinar: A DevOps Guide to Database Infrastructure Automation for eCommerce

 
December 17, 2014
By Severalnines

For an online shop, the website is the cash register. It has to be open for business 24 hours a day.

As the ops person on duty, when you get a call at 3am after your website went down, your priority number one is to restore the service asap. But why can we not have our application stack automatically recover, and not have the pager wake us at all? Why do we still stick to tedious manual processes, which take up time and resources, and hinder future growth?

Infrastructure automation isn’t easy, but it’s not rocket science either, says Riaan Nolan. Riaan has been in operations for the past decade, and has built over a dozen eCommerce properties. Automation is a worthwhile investment for retailers serious about eCommerce, but deciding on which tools to invest in can be a confusing and overwhelming process.

Join us for this webinar to understand the key pain points that online retailers experience which indicate it’s time to invest in database automation. Our guest speaker this time will be Riaan Nolan of Foodpanda, Rocket Internet’s global online food delivery marketplace operating in over 40 countries. 

 

New Webinar: A DevOps Guide to Database Infrastructure Automation for eCommerce

 

DATE & TIME

 

Europe/MEA/APAC

Tuesday, February 17th 2015 at 09:00 GMT (UK) / 10:00 CET (Germany, France, Sweden)

Register Now

 

North America/LatAm

Tuesday, February 17th 2015 at 9:00 Pacific Time (US) / 12:00 Eastern Time (US)

Register Now

 

TOPICS 

  • eCommerce infrastructure challenges in 2014
  • Provisioning of test/QA and highly available production environments across multi-datacenter and multi-cloud environments
  • Building and maintaining configuration management systems such as Puppet and Chef
  • Enabling self-service infrastructure services to internal dev teams
  • Health and performance monitoring 
  • Capacity analysis and planning
  • Elastic scaling 
  • Automating failure handling
  • Disaster recovery

 

SPEAKER

riaan_nolan.jpg

     Riaan Nolan

  • Expert Live Systems Administrator, foodpanda | Hellofood
  • Senior Systems Administrator / Infrastructure Lead, Rocket Internet GmbH
  • Senior Technology Manager, Africa Internet Accelerator
  • Uses Amazon EC2, VPC and Autoscale with Cloudformation.
  • First Puppet Labs Certified Professional in South Africa. 
  • Specialties: Puppet Automation, Cloud Deployments, eCommerce, eMarketing, Specialized Linux Services, Windows, Process making, Budgets, Asset Tracking, Procurement

 

 


Galera Cluster for MySQL vs MySQL (NDB) Cluster: A High Level Comparison - Webinar Replay & Slides

 
December 16, 2014
By Severalnines

 

Thanks to everyone who attended and participated in last week’s webinar on 'Galera Cluster for MySQL vs MySQL (NDB) Cluster: A High Level Comparison'. If you missed the sessions or would like to watch the webinar again & browse through the slides, they are now available online.

 

In this webinar, Severalnines VP of Products, Alex Yu, who was part of the team at Ericsson who originally developed the NDB storage engine in 2001, gave an overview of the two clustering architectures and discussed their respective strengths and weaknesses: 

  1. MySQL Cluster architecture: strengths and limitations
  2. Galera Architecture: strengths and limitations
  3. Deployment scenarios
  4. Data migration
  5. Read and write workloads (Optimistic/pessimistic locking)
  6. WAN/Geographical replication
  7. Schema changes
  8. Management and monitoring

 

Watch the replay

 

Read the slides

 


Simple Backup Management of Galera Cluster using s9s_backup

 
December 8, 2014
By Severalnines

Percona XtraBackup is a great backup tool with lots of nice features to make online and consistent backups, although the variety of options can be a bit overwhelming. s9s_backup tries to make it simpler for users, it creates an easy to use interface for XtraBackup features such as full backups, incremental backups, streaming/non-streaming, and parallel compression.

Backups are organized into backup sets, consisting of a full backup and zero or more incremental backups. s9s_backup manages the LSNs (Log Sequence Number) of the XtraBackups. The backup set can then be restored as one single unit using just one command.

In earlier posts, we covered various ways on restoring your backup files onto a Galera Cluster, including point-in-time recovery and a Percona XtraBackup vs mysqldump comparison. In this post, we will show you how to restore your backup using s9s_backup, which comes with every ClusterControl installation. It is located under /usr/bin directory and can be called directly from your terminal environment.

 

s9s_backup vs s9s_backupc

 

The difference between the two utilities is the location where the backup data is stored. s9s_backupc will store the backup on the controller and it will be initiated from the ClusterControl server, while s9s_backup initiates and stores the backup locally on the database node. However, for restoring the backup, you can use any of the utilities regardless of your backup storage location. They will perform just the same.


Resources for Database Clusters: Galera vs MySQL Cluster Webinar, New ClusterControl User Guide and More

 
December 3, 2014
By Severalnines

Check Out Our Latest Technical Resources for MySQL, MariaDB & MongoDB Clusters

 

Here is a summary of resources & tools that we’ve made available to you in the past weeks. If you have any questions on these, feel free to contact us!

 

New Live Technical Webinars

 

webinar-galeravsndb.png

Galera Cluster for MySQL vs MySQL (NDB) Cluster - A High Level Comparison

 

MySQL Cluster is the official clustering solution from Oracle, while Galera Cluster for MySQL/MariaDB is slowly but surely establishing itself as the de-facto clustering solution in the wider MySQL and MariaDB ecosystem.

 

Europe/MEA/APAC

Thursday, December 11th 2014 at 09:00 GMT (UK) / 10:00 CET (Germany, France, Sweden)

Register Now

North America/LatAm

Thursday, December 11th 2014 at 9:00 Pacific Time (US) / 12:00 Eastern Time (US)

Register Now

 

In this webinar, we will look at these two alternatives for MySQL-based database clustering and present an unbiased view on their strengths/weaknesses as well as their use cases.

 

A DevOps Guide to Database Infrastructure Automation for eCommerce

 

Infrastructure automation isn’t easy, but it’s not rocket science either, says Riaan Nolan. Riaan has been in operations for the past decade, and has built over a dozen eCommerce properties. Automation is a worthwhile investment for retailers serious about eCommerce, but deciding on which tools to invest in can be a confusing and overwhelming process.

 

Europe/MEA/APAC

Tuesday, February 17th 2015 at 09:00 GMT (UK) / 10:00 CET (Germany, France, Sweden)

Register Now

North America/LatAm

Tuesday, February 17th 2015 at 9:00 Pacific Time (US) / 12:00 Eastern Time (US)

Register Now

 


Multi-source Replication with MariaDB Galera Cluster

 
December 1, 2014
By Severalnines

MariaDB 10 supports multi-source replication, and each MariaDB Galera node can have up to 64 masters connected to it. So it is possible to use a MariaDB Cluster as an aggregator for many single-instance MariaDB master servers.

In this blog post, we are going to show you how to setup multi-source replication with MariaDB Galera Cluster, where one of the Galera nodes is acting as slave to 3 MariaDB masters (see diagram below). If you would like to set this up with Percona XtraDB Cluster or Galera Cluster (Codership), please read this post instead.

 

MariaDB GTID vs MySQL GTID

 

MariaDB has a different implementation of Global Transaction ID (GTID), and is enabled by default starting from MariaDB 10.0.2. Multi-source replication in MariaDB works with both GTID and the legacy binlog file and position, as compared to the MySQL implementation

A GTID consists of three separated values:

  • Domain ID - Replication domain. A replication domain is a server or group of servers that generate a single, strictly ordered replication stream.
  • Server ID - Server identifier number to enable master and slave servers to identify themselves uniquely.
  • Event Group ID - A sequence number for a collection of events that are always applied as a unit. Every binlog event group (eg. transaction, DDL, non-transactional statement) is annotated with its GTID.

The figure below illustrates the differences between the two GTIDs:

In MariaDB, there is no special configuration needed on the server to start using GTID. Some of MariaDB GTID advantages:

  • It is easy to identify which server or domain the event group is originating from
  • You do not necessarily need to turn on binary logging on slaves
  • It allows multi-source replication with distinct domain ID
  • Enabling GTID features is dynamic, you don’t have to restart the MariaDB server
  • The state of the slave is recorded in a crash-safe way

Despite the differences between these two, it is still possible to replicate from MySQL 5.6 to MariaDB 10.0 or vice versa. However, you will not be able to use the GTID features to automatically pick the correct binlog position when switching to a new master. Old-style MySQL replication will work. We highly recommend you to read the MariaDB GTID knowledge base.

 

MariaDB Galera Cluster as Slave

 

In our setup, we used MariaDB 10.0.14 on masters and MariaDB Galera Cluster 10.0.14 as slave. We have three master servers (mariadb1, mariadb2, mariadb3) and each master has a separate database: mydb1, mydb2 and mydb3. The 3 servers replicate to a Galera node (mgc1) in multi-source mode.

When using multi-source replication, where a single slave connects to multiple masters, each master needs to be configured with its own distinct domain ID.


We’re hiring (again)! This time we’re looking for a great support engineer!

 
November 27, 2014
By Severalnines

 

image(2).jpeg

We're looking for a great and customer focused support engineer (preferably in North American/European timezones) to join our small and agile support team. This position is full-time and pay is negotiable. The hours are flexible and work can be done remotely; in fact, it will need to be done remotely, we all work from home ;-)

 

Severalnines is a self-funded startup with a dozen employees; headquartered in Stockholm, Sweden and with a globally distributed, home-office based team. We provide automation and management software for database clusters. Our ClusterControl product is the leading database automation platform for database clusters and is used by thousands of companies.

 

We were founded in 2011 and launched our product that same year, so you’ll be working with a popular, tried & tested product. There is opportunity to have an immediate impact though as we’re a small team and there is plenty of work to be done as the product continues to gain in popularity and our user-base continuously grows. 

 

The ideal candidate has the following skills set (see full description): 

  • 5 years experience with MySQL in production environments
  • Advanced knowledge of MySQL Clustering and Replication
    • Galera
    • NDB
    • MySQL Replication (async/semi)
  • Experience with database design, administration and architecture
  • Experience with NoSQL databases in production environments
    • For example MongoDB, Cassandra, Riak
  • Experience with AWS and/or OpenStack administration in production environments
    • Expertise in virtualization technologies (docker, xen, AWS EC2, vmware for example)
  • Experience in working remotely from home and collaborating with team members located in other countries
  • Good written/spoken English skills

 

A full job description can be found here: http://www.severalnines.com/careers

 


New Webinar: Galera Cluster for MySQL vs MySQL (NDB) Cluster: A High Level Comparison

 
November 26, 2014
By Severalnines

Galera Cluster for MySQL, Percona XtraDB Cluster and MariaDB Cluster (the three “flavours” of Galera Cluster) make use of the Galera WSREP libraries to handle synchronous replication.MySQL Cluster is the official clustering solution from Oracle, while Galera Cluster for MySQL is slowly but surely establishing itself as the de-facto clustering solution in the wider MySQL eco-system.  

In this webinar, we will look at all these alternatives and present an unbiased view on their strengths/weaknesses and the use cases that fit each alternative.

This webinar will cover the following:

  • MySQL Cluster architecture: strengths and limitations
  • Galera Architecture: strengths and limitations
  • Deployment scenarios
  • Data migration
  • Read and write workloads (Optimistic/pessimistic locking)
  • WAN/Geographical replication
  • Schema changes
  • Management and monitoring

 

DATE & TIME

Europe/MEA/APAC

Thursday, December 11th 2014 at 09:00 GMT (UK) / 10:00 CET (Germany, France, Sweden)

Register Now

North America/LatAm

Thursday, December 11th 2014 at 9:00 Pacific Time (US) / 12:00 Eastern Time (US)

Register Now

 

SPEAKER

Alex Yu, VP of Products, Severalnines

 


Multi-source Replication with Galera Cluster for MySQL

 
November 20, 2014
By Severalnines

Multi-source replication means that one server can have multiple masters from which it replicates. Why multi-source? One good reason is to consolidate databases (e.g. merge your shards) for analytical reporting or as a centralized backup server. MariaDB 10 already has this feature, and MySQL 5.7 will also support it. 

It is possible to set up your Galera Cluster as an aggregator of your masters in a multi-source replication setup, we’ll walk you through the steps in this blog. Note that the howto is for Galera Cluster for MySQL (Codership) and Percona XtraDB Cluster. In a separate post, we’ll show you how to configure MariaDB Cluster 10 instead. If you would like to use MySQL Cluster (NDB) as aggregator, then check out this blog.

 

Galera Cluster as Aggregator/Slave

 

Galera cluster can operate both as MySQL master and slave. Each Galera node can act as a slave channel accepting replication from a master. The number of slave channels should be equal or less to the number of Galera master nodes in the cluster. So, if you have a three-node Galera cluster, you can have up to three different replication sources connected to it. Note that in MariaDB Galera Cluster 10, you can configure as many sources as you want since each node supports multi-source replication. 

To achieve multi-source replication in MySQL 5.6, you cannot have GTID enabled for Galera Cluster. GTID will cause our Galera cluster to work as a single unit (imagine one single slave server), since it globally preserves the MySQL GTID events on the cluster.  So the cluster will not be able to replicate from more than one master. Hence, we will use the “legacy” way to determine the starting binary log file and position. On a side note, enabling GTID is highly recommended if your Galera Cluster acts as a MySQL master, as described in this blog post.

We will setup multi-source replication as below:

We have 3 standalone MySQL servers (masters), and each master has a separate database: mydb1, mydb2 and mydb3. We would like to consolidate all 3 databases into our Galera cluster.

 

Setting Up Masters

 

1. On each standalone MySQL server, configure it as a master by adding a server ID, enabling binary logging with ROW format:

# mysql1 my.cnf
server-id=101
log-bin=binlog
binlog-format=ROW

 

# mysql2 my.cnf
server-id=102
log-bin=binlog
binlog-format=ROW

 

# mysql3 my.cnf
server-id=103
log-bin=binlog
binlog-format=ROW

 


New ClusterControl User Guide for MySQL based Clusters

 
November 19, 2014
By Severalnines

Following the release of ClusterControl 1.2.8 with a range of cool new features, we have now also published a new ClusterControl User Guide that provides all the steps, tips & tricks to follow in order to successfully deploy, monitor, manage and scale database clusters.  

This user guide predominantly covers ClusterControl with MySQL-based clusters, namely:

  • Percona XtraDB Cluster
  • MariaDB Cluster
  • Galera Cluster for MySQL (Codership)
  • MySQL Cluster
  • MySQL Replication
  • A pool of MySQL single instances

 

New features in ClusterControl 1.2.8 include: 

  • Deployment and scaling of single-instance MySQL, MariaDB and MongoDB
  • YUM/APT repositories for ClusterControl
  • Alerts and incident tracking with PagerDuty
  • New flexible alarms/email notification system
  • Cluster-wide MySQL User Management
  • New default dashboards for MySQL/MariaDB
  • Puppet Module for ClusterControl

 


9 DevOps Tips for Going in Production with Galera Cluster for MySQL - Webinar Replay & Slides

 
November 14, 2014
By Severalnines

Thanks to everyone who attended and participated in this week's webinar on '9 DevOps Tips for Going in Production with Galera Cluster for MySQL'. If you missed the sessions or would like to watch the webinar again & browse through the slides, they are now available online.

 

In this webinar, Severalnines CTO Johan Andersson discussed 9 key aspects to consider before taking Galera Cluster for MySQL into production:

  • 101 Sanity Check
  • Operating System
  • Backup Strategies
  • Galera Recovery
  • Query Performance
  • Schema changes
  • Security / Encryption
  • Reporting
  • Protecting from Disasters

 

Watch the replay

 

Read the slides

 

Operations is not so much about specific technologies, but about the techniques and tools you use to deploy and manage them. Monitoring, managing schema changes and pushing them in production, performance optimizations, configurations, version upgrades, backups; these are all aspects to consider – preferably before going live.

 


Search
Keep in touch
Signup for our newsletter:
Name:
*Email:

Alex's Blog

Quickstart $ git clone https://github.com/alyu/docker.git $ cd docker/percona-xtradb-5.6/centos $ ./build.sh $ ./start-servers.sh 3 $ ./bootstrap-cluster.sh $ ssh root@172.17.0.2 (root123) $ mysql -...
41 weeks 3 days ago

Johan's Blog

FOREIGN KEYs in MySQL Cluster is a big step forward. It is now possible to run enterprise software with NDB Cluster as the storage backend. Over the years, the lack of FOREIGN KEYs have been one of...
1 year 25 weeks ago