Generating Flexible Random data in MySQL

I was about to benchmark the various compression methods in MySQL ( Via Engines ). But i liked to simulate my own data set similar to a production work load. Well searched for a tool which should be flexible to enough make customised table structure and more. Mysql_random_data_load is a tool from Percona labs used … Continue reading Generating Flexible Random data in MySQL

Backup and Recovery using Mariabackup.

A Database Engineer should always be aware of how the database stores valuable data and also to safeguard it. Data may be lost due to a lot of reasons like some critical problems in the hardware, crashes, human mistakes, and more other reasons. That is why we need to take database backups. To make backups … Continue reading Backup and Recovery using Mariabackup.

Deduplication of B Tree Indexes in PostgreSQL 13

PostgreSQL 13 is generally available from September 24, 2020. Last year, PostgreSQL 12 was released with a lot of features like Generated Columns, Partitioning Improvements and so on and started to be widely used in Production Environments. This year, PostgreSQL 13 comes up with more exciting features as well as performance and security improvements. Here … Continue reading Deduplication of B Tree Indexes in PostgreSQL 13

Integrating MariaDB Audit plugin in MySQL 5.7

Basically, Auditing is the process of monitoring and recording the activity happening inside the Server. MariaDB Audit Plugin works with MariaDB, MySQL and Percona Servers. It is used to log the database Operations like, SQL Statements, User informations, Connections. The information is stored in a user defined log file or in Syslog. Available audit plugins … Continue reading Integrating MariaDB Audit plugin in MySQL 5.7

MongoDB Transaction a walk through

Mydbops MongoDB

In this blog I will walk through the Transaction in MongoDB. It's quite an interesting topic to discuss, nowadays most of the NoSQL technology adopting transactions in their database system and MongoDB also not an exception in this. The WiredTiger storage engine plays a very vital role in accomplishing the transaction in MongoDB. The interesting … Continue reading MongoDB Transaction a walk through

Integrating MySQL tools with Systemd Service

In my day to day tasks as a DB Engineer at Mydbops we have been using multiple MySQL tools for multiple use cases to ensure an optimal performance and availability for servers managed by our Remote DBA Team. A tool like pt-online-schema can be used for any DDL changes ( Overview to DDL algorithm ), … Continue reading Integrating MySQL tools with Systemd Service

Two Methods of ClickHouse Backup and Recovery

ClickHouse is known as a data analytics processing engine. ClickHouse is one of the open-source column-oriented database-oriented management systems capable of real-time generation of analytical data reports using SQL queries. Clickhouse came a long way since it inception 3 years ago. Why Mydbops recommends ClickHouse for Analytics ? ClickHouse is a Columnar Store built for … Continue reading Two Methods of ClickHouse Backup and Recovery

Exploring Logical Backup in PostgreSQL.

                      Backup and Recovery is one of the most essential jobs for every database administrator. We all know the importance of the backups for the databases. Here I am not going to write its importance, rather about the different types of backup tools available for … Continue reading Exploring Logical Backup in PostgreSQL.

A Linux Tool to Monitor Progress of MySQL Data Imports and Exports.

One problem I have experienced during logical exporting and importing databases is the tools don’t output any progress indicator (or anything at all really) and using the -v (verbose) switch outputs every single MySQL command being run from the import file. As, importing and exporting of databases  is one of the most frequent activity being … Continue reading A Linux Tool to Monitor Progress of MySQL Data Imports and Exports.

3 Step Migration of MySQL data to Clickhouse for faster analytics.

Recently one of our client approach Mydbops with Query slowness on a MySQL environment . They deployed the new code for generate the huge reports for the year end analytics data . After the deployment the queries were extremely slow and they struggled lot , then they approached us for the solution. After the analysis, … Continue reading 3 Step Migration of MySQL data to Clickhouse for faster analytics.