MySQL Schema change With Skeema – Part 1 “Basic Operations”

As a Database Engineer, One of the biggest challenges in day-to-day activity is performing DDL on high-traffic and transaction-intensive tables. It will become overhead when handling a large number of servers/shards. As a standard process, we will first deploy the changes in DEV and QA before deploying them in production. In the sharded environment, It … Continue reading MySQL Schema change With Skeema – Part 1 “Basic Operations”

AWS MySQL Security on RDS: Database Level

In the previous blog, we have gone through about network-level security in RDS. In this blog, we will see about the Database level security in RDS. After network-level restriction to host, we can't allow a user to connect to the database from anywhere over the internet. We need to restrict user access at the Database … Continue reading AWS MySQL Security on RDS: Database Level

Introduction to AWS MySQL Security on RDS : Network

Nowadays everything is getting digitalized and migration toward the cloud is at its peak. There is a high chance of data leaks if we don't tighten the security of the Database servers. It is mandatory to secure the database by restricting access to Database. Although we have restricted the access. We need to monitor the … Continue reading Introduction to AWS MySQL Security on RDS : Network

MySQL “No space left on device from storage engine”

We have planned for archiving the data to improve the DB performance and to reclaim the space. We were evaluating Compression in InnoDB and TokuDB. To find out the best compression method. We started benchmarking the compression ratio between InnoDB and TokuDB. Everything goes well for some time, but after a few hours got an … Continue reading MySQL “No space left on device from storage engine”

Handling case sensitive column in pt-archiver

To copy the data of the particular column of the table to another table/server, We have an option to export the data as CSV and import the data back to a different table. But when the table size is large and we need to copy the data only for the required data to the target … Continue reading Handling case sensitive column in pt-archiver

Troubleshooting an unique key addition during pt-online-schema-change

We all tried various alternative methods for modifying the table structure, but pt-online-schema-change (pt-osc) is the most convenient and preferred method for performing the alter online. It has more granular control too. But it may lead to data loss if proper precautionary steps are not taken care of. In this blog, we are going to … Continue reading Troubleshooting an unique key addition during pt-online-schema-change

Aurora MySQL Parallel query Performance and its gains

As a continuation to my previous blog , I have made benchmarking to find the performance improvement using parallel query.Before starting the testing, we will go through the monitoring stats variables and query analysis (explain). Monitoring Aurora Parallel Query stats S:NoParameter Purpose 1Aurora_pq_request_attemptedNo of attempt that query tried to use parallel query feature.2Aurora_pq_request_executedNo of query … Continue reading Aurora MySQL Parallel query Performance and its gains

Introduction to MySQL Parallel query in AWS Aurora

Aurora has a salient feature "Parallel query", Which will be more beneficial for analytical workload environments. Before going to deep dive on this particular feature, let us understand the basis of Aurora. Aurora Archiecture Key feature The key feature of Aurora is simple data synchronisation among the nodes. The sync latency will be too low … Continue reading Introduction to MySQL Parallel query in AWS Aurora

Generating Flexible Random data in MySQL

I was about to benchmark the various compression methods in MySQL ( Via Engines ). But i liked to simulate my own data set similar to a production work load. Well searched for a tool which should be flexible to enough make customised table structure and more. Mysql_random_data_load is a tool from Percona labs used … Continue reading Generating Flexible Random data in MySQL

Integrating MariaDB Audit plugin in MySQL 5.7

Basically, Auditing is the process of monitoring and recording the activity happening inside the Server. MariaDB Audit Plugin works with MariaDB, MySQL and Percona Servers. It is used to log the database Operations like, SQL Statements, User informations, Connections. The information is stored in a user defined log file or in Syslog. Available audit plugins … Continue reading Integrating MariaDB Audit plugin in MySQL 5.7