MySQL Schema Maintenance

MySQL schema maintenance

Giuseppe MaxiaMySQL Community Team Lead

This work is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported License.

Thursday, 03 December 2009

about me - Giuseppe Maxia a.k.a. The Data Charmer MySQL Community Team Lead Long time MySQL hacker Formerly, database consultant, designer, coder. A passion for QA An even greater passion for open source ... and community Passionate blogger http://datacharmer.blogspot.com

Schema what?

In a relational database, the schema defines the tables, the fields in each table, and the relationships between fields and tables.

http://en.wikipedia.org/wiki/Schema_(database)

tables

table nametable nametable name

column column column

tables

table nametable nametable name

column column column

CREATE TABLE employees ( ID INT NOT NULL, name VARCHAR(20), salary INT, PRIMARY KEY (ID))

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

departmentsdepartments

ID INT

name varchar (10)

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

ID INT

name varchar (10)

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

ID INT

name varchar (10)

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

manymany

relationship

employeesemployees

ID INT

name varchar (10)

salary INT

dept_ID INT

salessales

cust_ID INT

emp_ID INT

s_date DATE

amount DECIMAL

customercustomer

ID INT

name varchar (10)

manymany

many to many

Main actors

• Production

• Development

• Stage

• Test

Production database

• You must have one

Development database

• Where you create new thingsThursday, 03 December 2009

Test database

• Where you experiment crazy ideas

Stage database

• Where you test before deploying to production

Schema maintenance actions

• Reverse engineering

• Forward engineering

• Synchronization

Reverse Engineering

DDLdept_empdept_empdept_emp

departmentdepartmentdepartment

dept_managerdept_managerdept_manager

employeesemployeesemployees

titlestitlestitles

salariessalariessalaries

Reverse Engineering

titlestitlestitles

Reverse Engineering

titlestitlestitles

Forward Engineering

titlestitlestitles

Forward Engineering

titlestitlestitles

WARNING!

Forward engineerin

g is destr

uctive.

Synchronization

How it works

Production

StageTest

Development

OK?yes

How else it works

Production

StageTest

Development

• Partition adjustment

• Dynamic schemas

• Hot fixes

What happens in between

Development

no What now?

Development

no What now? Wrong schema here

Development

no What now? Wrong schema here

REWIND?

Schema maintenance: how to

1. Poor man's wayThursday, 03 December 2009

How poor is the poor man?• only command line access• No Perl, PHP, or Python• Can't install anything

• Command line access• Perl or Python available• Can install modules

• Command line access• GUI• Can install everything

EXTREMELY

HOST 1

so, the extremely poor man's way ...

HOST 2

ProductionDevelopment

HOST 1

get the schema

TEXT FILE

HOST 2

HOST 1

get the schema

TEXT FILE

HOST 2

get the schema

TEXT FILE

HOST 1

get the schema

TEXT FILE

HOST 2

get the schema

TEXT FILE

HOST 1

get the schema

TEXT FILE

HOST 2

get the schema

TEXT FILE

then … uh … figure out how to continue

HOST 1

the poor man's way ...HOST 2

Perl Script

get the schema

TEXT FILE

get the schema

TEXT FILE

HOST 1

the poor man's way ...HOST 2

Perl Script

get the schema

TEXT FILE

get the schema

TEXT FILE

TELLS YOU WHAT TO DO

HOST 1

not so poor man's way ...HOST 2

Python Script

DOES A LOT OF THINGS

http://schemasync.org

HOST 1

not so poor man's way ...HOST 2

Python Script

DOES A LOT OF THINGS

http://schemasync.org

WARNING: doesn't deal with partitionsThursday, 03 December 2009

The rich man

http://aquafold.com

The rich man

http://aquafold.com

WARNING: doesn't deal with partitionsThursday, 03 December 2009

MySQL Workbench

http://wb.mysql.com

MySQL Workbench

http://wb.mysql.com

MySQL Workbench

http://wb.mysql.com

Schema and model

titlestitlestitles

Schema and model

titlestitlestitles

Physical schema

implemented in a specific DBMS

Physical schema

titlestitlestitles

implemented in a specific DBMS

Conceptual model

DBMS agnostic

Conceptual model

DBMS agnostic

MySQL Workbench basics

Creating tables (1)

Creating tables (2)

Creating tables (3)

Creating tables (4)

Creating tables (5)

database connections(1)

database connections(2)

Reverse engineering in the old world

show create table departments\G

Create Table: CREATE TABLE `departments`

`dept_id` int(10) unsigned NOT NULL,

`department` char(30) NOT NULL,

PRIMARY KEY (`dept_id`),

KEY `department` (`department`)

) ENGINE=InnoDB DEFAULT CHARSET=latin1

1 row in set (0.00 sec)

show create table departments\G

Create Table: CREATE TABLE `departments`

`dept_id` int(10) unsigned NOT NULL,

`department` char(30) NOT NULL,

PRIMARY KEY (`dept_id`),

KEY `department` (`department`)

) ENGINE=InnoDB DEFAULT CHARSET=latin1

1 row in set (0.00 sec)

Reverse engineering (1)

forward engineering in the old world

mysqldump --host=development -B \

--no-data crosstab > crosstab.sql

mysql --host=stage < crosstab.sql

Forward engineering (1)

synchronization in the old world

Synchronization (1)

Synchronization (2)

Synchronization (3)

Synchronization (4)

Synchronization (5)

Synchronization (6)

More goodies

• MySQL Workbench 5.2 (Beta) - live demo

Thanks

Let's talk!

MySQL Schema Maintenance

Technology

Transcript of MySQL Schema Maintenance

MySQL Information Schema · PDF fileThis is the MySQL Information Schema extract from ... representation to parse. • This technique is more ... the standard or in DB2, SQL

ArcSDE Schema Maintenance

OpenWorld 2014 - Schema Management: versioning and automation with Puppet and MySQL Utilities

Performance Schema in MySQL (Danil Zburivsky)

MySQL Performance Schema - percona.com · Metadata Always existed SHOW commands Information Schema Runtime Was not perfect Status variables Extensions for Information Schema History

MySQL 5.7 + JSON - FOSDEM · • No painful schema changes* • Easier prototyping • Fewer types to consider • No enforced schema, start storing values immediately 41 * MySQL

Online schema change in mysql casual #1(2010/12/11)

MySQL Information Schema · Abstract This is the MySQL Information Schema extract from the MySQL 5.7 Reference Manual. For legal information, see the Legal Notices. For help with

MySQL Performance Schema New enhancements in MySQL 5.7 Mayank Prasad Principal Member Technical Staff Oracle, MySQL October 1, 2014 Copyright © 2014,

AWS Schema Conversion Tool€¦ · MariaDB 10.2 and 10.3, Microsoft SQL Server, MySQL, PostgreSQL MySQL (version 5.5 and later) Aurora PostgreSQL, MySQL, PostgreSQL You can migrate

MySQL Performance Schema, Open Source India, 2015

MySQL Performance Schema - in Action...MySQL Performance Schema in Action April, 23, 2018 Sveta Smirnova, Alexander Rubin Performance Schema Conﬁguration 5.6+: Statements Instrumentation

How to Avoid Pitfalls in Schema Upgrade - with Galera · How to Avoid Pitfalls in Schema Upgrade with Galera February 2, 2020 Sveta Smirnova MySQL Support engineer Author of MySQL

MySQL Performance Schema - in Action Performance Schema in...MySQL Performance Schema in Action November, 5, 2018 Sveta Smirnova, Alexander Rubin with Nickolay Ihalainen ... PostgreSQL

Become a MySQL DBA - Webinars - Schema Changes for MySQL Replication & Galera Cluster (slides)

Mysql Workbench Create Physical Schema

MySQL Performance Schema · This is the MySQL Performance Schema extract from the MySQL 8.0 Reference Manual. For legal information, see the Legal Notices. For help with using MySQL,

MySQL Information Schema

Profiling with Performance Schema - MySQL · An Introduction to Performance Schema § A new default performance_schema schema within MySQL § Tables use new PERFORMANCE_SCHEMA storage

DBMS - Introduction to MySQL · Introduction to SQL Schemas and Databases A schema is a collection of entities and relationships. MySQL calls a schema a database. A database is the