Getting started with PGBouncer in PostgreSQL

Resource management is one of the key thing in all RDBMS. DB Connections is one of them. In PostgreSQL, Allocating more connections without proper analysis of resources causes an overhead in Memory usage and the creation of an OS process for each connection will lead to a scheduling overhead in the time-sharing operating system. These … Continue reading Getting started with PGBouncer in PostgreSQL

MySQL Group Replication and its Memory consumption (troubleshooting).

This blog is about one of the issues encountered by our Remote DBA Team in one of the production servers. We have a setup of MySQL 5.7 Single Primary (Writer) GR with cluster size of  3 . Due to OOM, the MySQL process in the primary node got killed, this repeated over the course of … Continue reading MySQL Group Replication and its Memory consumption (troubleshooting).

3 Step Migration of MySQL data to Clickhouse for faster analytics.

Recently one of our client approach Mydbops with Query slowness on a MySQL environment . They deployed the new code for generate the huge reports for the year end analytics data . After the deployment the queries were extremely slow and they struggled lot , then they approached us for the solution. After the analysis, … Continue reading 3 Step Migration of MySQL data to Clickhouse for faster analytics.

Troubleshooting an OLAP system on InnoDB

As a part of Mydbops Consulting we have a below problem statement from one of our client. "We have a high powered server for reporting which in turn powers our internal dashboard for viewing the logistics status.Even with a high end hardware, we had a heavy CPU usage and which in turn triggers spikes in … Continue reading Troubleshooting an OLAP system on InnoDB

Closer view of MongoDB Replica sets

Introduction Replication is not just a word, it is a technology ruling the data world. In Database, numerous elements contribute to the overall process of creating and managing database replication. In this blog, I will walk you through the Anatomy of MongoDB replica set. Types of Replication MongoDB Support Basically, MongoDB supports two types of … Continue reading Closer view of MongoDB Replica sets

MySQL 8.0 Clone Plugin and its internal process.

MySQL 8 has recently released clone plugin which makes DBA's task of rebuilding the DB servers more easy. Cloning is a process of creating an exact copy of the original. In technical terms cloning alias to (Backup + Recovery), MySQL database cloning requires a sequence of actions to be performed manually or in a scripted fashion … Continue reading MySQL 8.0 Clone Plugin and its internal process.

Save Space on MySQL data with Column Compression

                                   Recently, One of our client reached our Remote DBA team with a requirement to reduce the size of the table as it is having many text columns with huge number of records. At preliminary check , I have … Continue reading Save Space on MySQL data with Column Compression

MySQL Functional Index and use cases.

MySQL has introduced the concept of functional index in MySQL 8.0.13. It is one of the much needed feature for query optimisation , we have seen about histogram in my last blog. Let us explore the functional index and its use cases. For the below explanation, I have used a production scenario which has 16 … Continue reading MySQL Functional Index and use cases.

TaskMax limit affects MySQL connections

Recently we had been bitten by a Systemd limitation at the “Tasks” created per-unit ie., process. This includes both the kernel threads and user-space threads, with each thread counting individually. Am writing this blog as a reference for someone who might come across this limitation. We have been actively working on migration DB instances, from … Continue reading TaskMax limit affects MySQL connections

Presentation : JSON improvements in MySQL 8.0

MySQL User camp is one of the prestigious MySQL meetup happening in India for the past 6 years. Mydbops DBA's PonSuresh and Vignesh has presented about the "JSON functions and their improvements in MySQL 8.0" at MySQL User Camp Bangalore on 13-02-2019. JSON has been more improved a lot in MySQL 8.0 and improvements in … Continue reading Presentation : JSON improvements in MySQL 8.0