As a continuation to my previous blog , I have made benchmarking to find the performance improvement using parallel query.Before starting the testing, we will go through the monitoring stats variables and query analysis (explain). Monitoring Aurora Parallel Query stats S:NoParameter Purpose 1Aurora_pq_request_attemptedNo of attempt that query tried to use parallel query feature.2Aurora_pq_request_executedNo of query … Continue reading Aurora MySQL Parallel query Performance and its gains
Aurora has a salient feature "Parallel query", Which will be more beneficial for analytical workload environments. Before going to deep dive on this particular feature, let us understand the basis of Aurora. Aurora Archiecture Key feature The key feature of Aurora is simple data synchronisation among the nodes. The sync latency will be too low … Continue reading Introduction to MySQL Parallel query in AWS Aurora
Galera replicates the data across the cluster in a virtually synchronous fashion. Based on the availability of cluster nodes the type of data transfer can vary. The important factor which decides the type of data transfer required here is the existing write set in gcache. Galera Cluster stores write-sets in a special cache called the … Continue reading Major SST methods In XtraDB / MariaDB Cluster and its supporting files.
Galera is the core tech behind the Percona XtraDB Cluster and MariaDB Cluster. When using the Galera cluster we might have come across multiple files in the data directory beyond the Native MySQL or InnoDB Files. It is always good to understand these files to know what is happening internally. Each file present in the … Continue reading MariaDB/XtraDB Cluster Default Disk Files and its Significance
Over the decades we have been reading the MySQL error log from the server system file, if there are any issues in MySQL or any unknown restart happened , generally we look at the mysql error log. By default MySQL error log can be found in the default path /var/log/mysqld.log , or it can be … Continue reading MySQL ERROR Log Table Explained
Recently one of our customers ran into an issue, wherein a bad actor(code) from the application had made the wrong update to 16 M records of a critical table in the database, causing the entire production process to go down. The application Team was able to find the bad actor and block it, our Remote … Continue reading 6 Step MySQL Point-In-Time recovery on AWS RDS
A Database Engineer should always be aware of how the database stores valuable data and also to safeguard it. Data may be lost due to a lot of reasons like some critical problems in the hardware, crashes, human mistakes, and more other reasons. That is why we need to take database backups. To make backups … Continue reading Backup and Recovery using Mariabackup.
PXC(Percona XtraDB Cluster), aka Galera cluster, is one of my favorite clustering technology for MySQL that comes with real Multi-master capabilities, Write-set based nearly real-time replication and many more features. I could proudly say that Mydbops is one of the very few companies who have been supporting mission-critical clusters and preaching PXC ie., Galera cluster … Continue reading XtraDB Cluster troubleshooting a rejected node.
In my day to day tasks as a DB Engineer at Mydbops we have been using multiple MySQL tools for multiple use cases to ensure an optimal performance and availability for servers managed by our Remote DBA Team. A tool like pt-online-schema can be used for any DDL changes ( Overview to DDL algorithm ), … Continue reading Integrating MySQL tools with Systemd Service
ClickHouse is known as a data analytics processing engine. ClickHouse is one of the open-source column-oriented database-oriented management systems capable of real-time generation of analytical data reports using SQL queries. Clickhouse came a long way since it inception 3 years ago. Why Mydbops recommends ClickHouse for Analytics ? ClickHouse is a Columnar Store built for … Continue reading Two Methods of ClickHouse Backup and Recovery