MySQL 5.5.49 大内存优化配置文件优化详解
一、配置文件说明
my-small.cnf
my-medium.cnf
my-large.cnf
my-huge.cnf
my-innodb-heavy-4g.cnf
二、详解 my-innodb-heavy-4g.cnf
三、配置文件优化
注:环境说明,cento5.5 x86_64+mysql-5.5.32 相关软件下载:http://yunpan.cn/qtaculhlrkzrq
一、配置文件说明
mysql-5.5.49是mysql5.5系列中最后一个版本,也是最后一个有配置文件的版本,为什么这么说呢,用过5.6的博友都知道,在mysql5.6中已经不提供配置文件选择,只有一个默认的配置文件,好了,我们今天说的是5.5.49这个版,就不和大家说5.6了,下面我们来具体说一下,mysql5.5.49中,提供可选的几个配置文件,
my-small.cnf
my-medium.cnf
my-large.cnf
my-huge.cnf
my-innodb-heavy-4g.cnf
下面我们就来分别的看一下^_^……
1.my-small.cnf
[root@mysql support-files]# vim my-small.cnf # example mysql config file for small systems. # this is for a system with little memory (<= 64m) where mysql is only used # from time to time and it's important that the mysqld daemon # doesn't use much resources.
这是my-small.cnf配置文件中开头的简介,它说明了,这个配置文件是在内存小于等于64m时使用的,小型数据库系统,目的是不占更多的系统资源!
2.my-medium.cnf
[root@mysql support-files]# vim my-medium.cnf # example mysql config file for medium systems. # this is for a system with little memory (32m - 64m) where mysql plays # an important part, or systems up to 128m where mysql is used together with # other programs (such as a web server)
这个配置文件是中型数据系统使用,内存在128m左右!
3.my-large.cnf
[root@mysql support-files]# vim my-large.cnf # example mysql config file for large systems. # this is for a large system with memory = 512m where the system runs mainly # mysql.
这个配置文件是大型数据库系统使用,内存在512m左右!
4.my-huge.cnf
[root@mysql support-files]# vim my-huge.cnf # example mysql config file for very large systems. # this is for a large system with memory of 1g-2g where the system runs mainly # mysql.
这个配置文件是巨型数据库系统使用,内存在1g-2g左右!
5.my-innodb-heavy-4g.cnf
[root@mysql support-files]# vim my-innodb-heavy-4g.cnf #begin config info #descr: 4gb ram, innodb only, acid, few connections, heavy queries #type: system #end config info # this is a mysql example config file for systems with 4gb of memory # running mostly mysql using innodb only tables and performing complex # queries with few connections.
这个配置文件主要作用是,支持4g内存,支持innodb引擎,支持事务(acid)等特性所使用!
说明:acid,指数据库事务正确执行的四个基本要素的缩写。包含:原子性(atomicity)、一致性(consistency)、隔离性(isolation)、持久性(durability)!
6.总结
从上面的说明我们可以出,基本是通过内存大小来选择mysql的配置文件的,那有博友会说了,现在的服务器动不动就是32g内存或者64g内存,甚至更大的内存,你那个配置文件最大只支持4g内存是不是有点小了,确认会有这样的问题,从mysql5.6以后,为了更大的发挥mysql的性能,已经去除了配置文件选择,只有一个默认的配置文件,里面只有一些基本配置,所有设置管理员都可以根据自己实际的需求进行自行设置,好了说了这么多,我们就来说一说,在企业的用的最多的my-innodb-heavy-4g.cnf配置文件!
二、详解 my-innodb-heavy-4g.cnf
1.详细说明
注:下面是my-innodb-heavy-4g.cnf默认配置我没有做任何修改,下面我们就来详细的说一说!
[root@mysql support-files]# vim my-innodb-heavy-4g.cnf #begin config info #descr: 4gb ram, innodb only, acid, few connections, heavy queries #type: system #end config info # # this is a mysql example config file for systems with 4gb of memory # running mostly mysql using innodb only tables and performing complex # queries with few connections. # # mysql programs look for option files in a set of # locations which depend on the deployment platform. # you can copy this option file to one of those # locations. for information about these locations, see: # http://dev.mysql.com/doc/mysql/en/option-files.html # # in this file, you can use all long options that a program supports. # if you want to know which options a program supports, run the program # with the "--help" option. # # more detailed information about the individual options can also be # found in the manual. # # # the following options will be read by mysql client applications. # note that only client applications shipped by mysql are guaranteed # to read this section. if you want your own mysql client program to # honor these values, you need to specify it as an option during the # mysql client library initialization. # # 以下选项会被mysql客户端应用读取, 注意只有mysql附带的客户端应用程序保证可以读取这段内容,如果你想你自己的mysql应用程序获取这些值,需要在mysql客户端库初始化的时候指定这些选项 [client] #password = [your_password] #mysql客户端连接mysql时的密码 port = 3306 #mysql客户端连接时的默认端口 socket = /tmp/mysql.sock #与mysql服务器本地通信所使用的socket文件路径 # *** application-specific options follow here *** # # the mysql server # [mysqld] # generic configuration options #一般配置选项 port = 3306 #mysql服务器监听的默认端口 socket = /tmp/mysql.sock #socket本地通信文件路径 # back_log is the number of connections the operating system can keep in # the listen queue, before the mysql connection manager thread has # processed them. if you have a very high connection rate and experience # "connection refused" errors, you might need to increase this value. # check your os documentation for the maximum value of this parameter. # attempting to set back_log higher than your operating system limit # will have no effect. # back_log 是操作系统在监听队列中所能保持的连接数, # 队列保存了在mysql连接管理器线程处理之前的连接. # 如果你有非常高的连接率并且出现“connection refused”报错, # 你就应该增加此处的值. # 检查你的操作系统能打开文件数来获取这个变量的最大值. # 如果将back_log设定到比你操作系统限制更高的值,将会没有效果 back_log = 50 # don't listen on a tcp/ip port at all. this can be a security # enhancement, if all processes that need to connect to mysqld run # on the same host. all interaction with mysqld must be made via unix # sockets or named pipes. # note that using this option without enabling named pipes on windows # (via the "enable-named-pipe" option) will render mysqld useless! # 不在tcp/ip端口上进行监听. # 如果所有的进程都是在同一台服务器连接到本地的mysqld, # 这样设置将是增强安全的方法 # 所有mysqld的连接都是通过unix sockets 或者命名管道进行的. # 注意在windows下如果没有打开命名管道选项而只是用此项 # (通过 “enable-named-pipe” 选项) 将会导致mysql服务没有任何作用! #skip-networking #默认是没有开启的 # the maximum amount of concurrent sessions the mysql server will # allow. one of these connections will be reserved for a user with # super privileges to allow the administrator to login even if the # connection limit has been reached. # mysql 服务器所允许的同时会话数的上限 # 其中一个连接将被super权限保留作为管理员登录. # 即便已经达到了连接数的上限. max_connections = 100 # maximum amount of errors allowed per host. if this limit is reached, # the host will be blocked from connecting to the mysql server until # "flush hosts" has been run or the server was restarted. invalid # passwords and other errors during the connect phase result in # increasing this value. see the "aborted_connects" status variable for # global counter. # 每个客户端连接最大的错误允许数量,如果达到了此限制. # 这个客户端将会被mysql服务阻止直到执行了”flush hosts” 或者服务重启 # 非法的密码以及其他在链接时的错误会增加此值. # 查看 “aborted_connects” 状态来获取全局计数器. max_connect_errors = 10 # the number of open tables for all threads. increasing this value # increases the number of file descriptors that mysqld requires. # therefore you have to make sure to set the amount of open files # allowed to at least 4096 in the variable "open-files-limit" in # section [mysqld_safe] # 所有线程所打开表的数量. # 增加此值就增加了mysqld所需要的文件描述符的数量 # 这样你需要确认在[mysqld_safe]中 “open-files-limit” 变量设置打开文件数量允许至少2048 table_open_cache = 2048 # enable external file level locking. enabled file locking will have a # negative impact on performance, so only use it in case you have # multiple database instances running on the same files (note some # restrictions still apply!) or if you use other software relying on # locking myisam tables on file level. # 允许外部文件级别的锁. 打开文件锁会对性能造成负面影响 # 所以只有在你在同样的文件上运行多个数据库实例时才使用此选项(注意仍会有其他约束!) # 或者你在文件层面上使用了其他一些软件依赖来锁定myisam表 #external-locking #默认是没有开启的 # the maximum size of a query packet the server can handle as well as # maximum query size server can process (important when working with # large blobs). enlarged dynamically, for each connection. # 服务所能处理的请求包的最大大小以及服务所能处理的最大的请求大小(当与大的blob字段一起工作时相当必要) # 每个连接独立的大小.大小动态增加 max_allowed_packet = 16m # the size of the cache to hold the sql statements for the binary log # during a transaction. if you often use big, multi-statement # transactions you can increase this value to get more performance. all # statements from transactions are buffered in the binary log cache and # are being written to the binary log at once after the commit. if the # transaction is larger than this value, temporary file on disk is used # instead. this buffer is allocated per connection on first update # statement in transaction # 在一个事务中binlog为了记录sql状态所持有的cache大小 # 如果你经常使用大的,多声明的事务,你可以增加此值来获取更大的性能. # 所有从事务来的状态都将被缓冲在binlog缓冲中然后在提交后一次性写入到binlog中 # 如果事务比此值大, 会使用磁盘上的临时文件来替代. # 此缓冲在每个连接的事务第一次更新状态时被创建 binlog_cache_size = 1m # maximum allowed size for a single heap (in memory) table. this option # is a protection against the accidential creation of a very large heap # table which could otherwise use up all memory resources. # 独立的内存表所允许的最大容量. # 此选项为了防止意外创建一个超大的内存表导致永尽所有的内存资源. max_heap_table_size = 64m # size of the buffer used for doing full table scans. # allocated per thread, if a full scan is needed. #mysql读入缓冲区大小。对表进行顺序扫描的请求将分配一个读入缓冲区,mysql会为它分#配一段内存缓冲区。read_buffer_size变量控制这一缓冲区的大小。如果对表的顺序扫描请求非常频繁,#并且你认为频繁扫描进行得太慢,可以通过增加该变量值以及内存缓冲区大小提高其性能。 read_buffer_size = 2m # when reading rows in sorted order after a sort, the rows are read # through this buffer to avoid disk seeks. you can improve order by # performance a lot, if set this to a high value. # allocated per thread, when needed. #是mysql的随机读缓冲区大小。当按任意顺序读取行时(例如,按照排序顺序),将分配一个随机读缓存区。进行排序查询时,mysql会首先扫描一遍该缓冲,以避免磁盘搜索,提高查询速度,如果需#要排序大量数据,可适当调高该值。但mysql会为每个客户连接发放该缓冲空间,所以应尽量适当设置该值,以避免内存开销过大。 read_rnd_buffer_size = 16m # sort buffer is used to perform sorts for some order by and group by # queries. if sorted data does not fit into the sort buffer, a disk # based merge sort is used instead - see the "sort_merge_passes" # status variable. allocated per thread if sort is needed. # 排序缓冲被用来处理类似order by以及group by队列所引起的排序 # 如果排序后的数据无法放入排序缓冲, # 一个用来替代的基于磁盘的合并分类会被使用 # 查看 “sort_merge_passes” 状态变量. # 在排序发生时由每个线程分配 sort_buffer_size = 8m # this buffer is used for the optimization of full joins (joins without # indexes). such joins are very bad for performance in most cases # anyway, but setting this variable to a large value reduces the # performance impact. see the "select_full_join" status variable for a # count of full joins. allocated per thread if full join is found # 此缓冲被使用来优化全联合(full joins 不带索引的联合). # 类似的联合在极大多数情况下有非常糟糕的性能表现, # 但是将此值设大能够减轻性能影响. # 通过 “select_full_join” 状态变量查看全联合的数量 # 当全联合发生时,在每个线程中分配 join_buffer_size = 8m # how many threads we should keep in a cache for reuse. when a client # disconnects, the client's threads are put in the cache if there aren't # more than thread_cache_size threads from before. this greatly reduces # the amount of thread creations needed if you have a lot of new # connections. (normally this doesn't give a notable performance # improvement if you have a good thread implementation.) # 我们在cache中保留多少线程用于重用 # 当一个客户端断开连接后,如果cache中的线程还少于thread_cache_size, # 则客户端线程被放入cache中. # 这可以在你需要大量新连接的时候极大的减少线程创建的开销 # (一般来说如果你有好的线程模型的话,这不会有明显的性能提升.) thread_cache_size = 8 # this permits the application to give the threads system a hint for the # desired number of threads that should be run at the same time. this # value only makes sense on systems that support the thread_concurrency() # function call (sun solaris, for example). # you should try [number of cpus]*(2..4) for thread_concurrency # 此允许应用程序给予线程系统一个提示在同一时间给予渴望被运行的线程的数量. # 此值只对于支持 thread_concurrency() 函数的系统有意义( 例如sun solaris). # 你可可以尝试使用 [cpu数量]*(2..4) 来作为thread_concurrency的值 thread_concurrency = 8 # query cache is used to cache select results and later return them # without actual executing the same query once again. having the query # cache enabled may result in significant speed improvements, if your # have a lot of identical queries and rarely changing tables. see the # "qcache_lowmem_prunes" status variable to check if the current value # is high enough for your load. # note: in case your tables change very often or if your queries are # textually different every time, the query cache may result in a # slowdown instead of a performance improvement. # 查询缓冲常被用来缓冲 select 的结果并且在下一次同样查询的时候不再执行直接返回结果. # 打开查询缓冲可以极大的提高服务器速度, 如果你有大量的相同的查询并且很少修改表. # 查看 “qcache_lowmem_prunes” 状态变量来检查是否当前值对于你的负载来说是否足够高. # 注意: 在你表经常变化的情况下或者如果你的查询原文每次都不同, # 查询缓冲也许引起性能下降而不是性能提升. query_cache_size = 64m # only cache result sets that are smaller than this limit. this is to # protect the query cache of a very large result set overwriting all # other query results. # 只有小于此设定值的结果才会被缓冲 # 此设置用来保护查询缓冲,防止一个极大的结果集将其他所有的查询结果都覆盖. query_cache_limit = 2m # minimum word length to be indexed by the full text search index. # you might wish to decrease it if you need to search for shorter words. # note that you need to rebuild your fulltext index, after you have # modified this value. # 被全文检索索引的最小的字长. # 你也许希望减少它,如果你需要搜索更短字的时候. # 注意在你修改此值之后, # 你需要重建你的 fulltext 索引 ft_min_word_len = 4 # if your system supports the memlock() function call, you might want to # enable this option while running mysql to keep it locked in memory and # to avoid potential swapping out in case of high memory pressure. good # for performance. # 如果你的系统支持 memlock() 函数,你也许希望打开此选项用以让运行中的mysql在在内存高度紧张的时候,数据在内存中保持锁定并且防止可能被swapping out # 此选项对于性能有益 #memlock # table type which is used by default when creating new tables, if not # specified differently during the create table statement. # 当创建新表时作为默认使用的表类型, # 如果在创建表示没有特别执行表类型,将会使用此值 default-storage-engine = myisam # thread stack size to use. this amount of memory is always reserved at # connection time. mysql itself usually needs no more than 64k of # memory, while if you use your own stack hungry udf functions or your # os requires more stack for some operations, you might need to set this # to a higher value. # 线程使用的堆大小. 此容量的内存在每次连接时被预留. # mysql 本身常不会需要超过64k的内存 # 如果你使用你自己的需要大量堆的udf函数 # 或者你的操作系统对于某些操作需要更多的堆, # 你也许需要将其设置的更高一点. thread_stack = 192k # set the default transaction isolation level. levels available are: # 设定默认的事务隔离级别.可用的级别如下: # read-uncommitted, read-committed, repeatable-read, serializable transaction_isolation = repeatable-read # maximum size for internal (in-memory) temporary tables. if a table # grows larger than this value, it is automatically converted to disk # based table this limitation is for a single table. there can be many # of them. # 内部(内存中)临时表的最大大小 # 如果一个表增长到比此值更大,将会自动转换为基于磁盘的表. # 此限制是针对单个表的,而不是总和. tmp_table_size = 64m # enable binary logging. this is required for acting as a master in a # replication configuration. you also need the binary log if you need # the ability to do point in time recovery from your latest backup. # 打开二进制日志功能. # 在复制(replication)配置中,作为master主服务器必须打开此项 # 如果你需要从你最后的备份中做基于时间点的恢复,你也同样需要二进制日志. log-bin=mysql-bin # binary logging format - mixed recommended #设定记录二进制日志的格式,有三种格式,基于语句 statement、 基于行 row、 混合方式 mixed binlog_format=mixed # if you're using replication with chained slaves (a->b->c), you need to # enable this option on server b. it enables logging of updates done by # the slave thread into the slave's binary log. # 如果你在使用链式从服务器结构的复制模式 (a->b->c), # 你需要在服务器b上打开此项. # 此选项打开在从线程上重做过的更新的日志, # 并将其写入从服务器的二进制日志. #log_slave_updates # enable the full query log. every query (even ones with incorrect # syntax) that the server receives will be logged. this is useful for # debugging, it is usually disabled in production use. # 打开查询日志. 所有的由服务器接收到的查询 (甚至对于一个错误语法的查询) # 都会被记录下来. 这对于调试非常有用, 在生产环境中常常关闭此项. #log #默认是没有开启的,会影响服务器性能 # print warnings to the error log file. if you have any problem with # mysql you should enable logging of warnings and examine the error log # for possible explanations. # 将警告打印输出到错误log文件. 如果你对于mysql有任何问题 # 你应该打开警告log并且仔细审查错误日志,查出可能的原因. #log_warnings # log slow queries. slow queries are queries which take more than the # amount of time defined in "long_query_time" or which do not use # indexes well, if log_short_format is not enabled. it is normally good idea # to have this turned on if you frequently add new queries to the # system. # 记录慢速查询. 慢速查询是指消耗了比 “long_query_time” 定义的更多时间的查询. # 如果 log_long_format 被打开,那些没有使用索引的查询也会被记录. # 如果你经常增加新查询到已有的系统内的话. 一般来说这是一个好主意 slow_query_log # all queries taking more than this amount of time (in seconds) will be # trated as slow. do not use "1" as a value here, as this will result in # even very fast queries being logged from time to time (as mysql # currently measures time with second accuracy only). # 所有的使用了比这个时间(以秒为单位)更多的查询会被认为是慢速查询. # 不要在这里使用”1″, 否则会导致所有的查询,甚至非常快的查询页被记录下来(由于mysql 目前时间的精确度只能达到秒的级别). long_query_time = 2 # *** replication related settings # *** 主从复制相关的设置 # unique server identification number between 1 and 2^32-1. this value # is required for both master and slave hosts. it defaults to 1 if # "master-host" is not set, but will mysql will not function as a master # if it is omitted. # 唯一的服务辨识号,数值位于 1 到 2^32-1之间. # 此值在master和slave上都需要设置. # 如果 “master-host” 没有被设置,则默认为1, 但是如果忽略此选项,mysql不会作为master生效. server-id = 1 # replication slave (comment out master section to use this) #复制的slave (去掉master段的注释来使其生效) # # to configure this host as a replication slave, you can choose between # two methods : #为了配置此主机作为复制的slave服务器,你可以选择两种方法: # # 1) use the change master to command (fully described in our manual) - # the syntax is: #使用 change master to 命令 (在我们的手册中有完整描述) - # 语法如下: # # change master to master_host=<host>, master_port=<port>, # master_user=<user>, master_password=<password> ; # # where you replace <host>, <user>, <password> by quoted strings and # <port> by the master's port number (3306 by default). # 你需要替换掉 , , 等被尖括号包围的字段以及使用master的端口号替换 (默认3306). # example: 案例 # # change master to master_host='125.564.12.1', master_port=3306, # master_user='joe', master_password='secret'; # # or 或者 # # 2) set the variables below. however, in case you choose this method, then # start replication for the first time (even unsuccessfully, for example # if you mistyped the password in master-password and the slave fails to # connect), the slave will create a master.info file, and any later # changes in this file to the variable values below will be ignored and # overridden by the content of the master.info file, unless you shutdown # the slave server, delete master.info and restart the slaver server. # for that reason, you may want to leave the lines below untouched # (commented) and instead use change master to (see above) # #设置以下的变量. 不论如何, 在你选择这种方法的情况下, 然后第一次启动复制(甚至不成功的情况下, # 例如如果你输入错密码在master-password字段并且slave无法连接), # slave会创建一个 master.info 文件,并且之后任何对于包含在此文件内的参数的变化都会被忽略 # 并且由 master.info 文件内的内容覆盖, 除非你关闭slave服务, 删除 master.info 并且重启slave 服务. # 由于这个原因,你也许不想碰一下的配置(注释掉的) 并且使用 change master to (查看上面) 来代替 # required unique id between 2 and 2^32 - 1 # (and different from the master) # defaults to 2 if master-host is set # but will not function as a slave if omitted # 所需要的唯一id号位于 2 和 2^32 – 1之间 # (并且和master不同) # 如果master-host被设置了.则默认值是2 # 但是如果省略,则不会生效 #server-id = 2 # # the replication master for this slave – required # 复制结构中的master – 必须 #master-host = <hostname> # # the username the slave will use for authentication when connecting # to the master – required # 当连接到master上时slave所用来认证的用户名 – 必须 #master-user = <username> # # the password the slave will authenticate with when connecting to # the master – required # 当连接到master上时slave所用来认证的密码 – 必须 #master-password = <password> # # the port the master is listening on. # optional - defaults to 3306 # master监听的端口. # 可选 – 默认是3306 #master-port = <port> # make the slave read-only. only users with the super privilege and the # replication slave thread will be able to modify data on it. you can # use this to ensure that no applications will accidently modify data on # the slave instead of the master # 使得slave只读.只有用户拥有super权限和在上面的slave线程能够修改数据. # 你可以使用此项去保证没有应用程序会意外的修改slave而不是master上的数据 #read_only #*** myisam specific options #*** myisam 相关选项 # size of the key buffer, used to cache index blocks for myisam tables. # do not set it larger than 30% of your available memory, as some memory # is also required by the os to cache rows. even if you're not using # myisam tables, you should still set it to 8-64m as it will also be # used for internal temporary disk tables. # 关键词缓冲的大小, 一般用来缓冲myisam表的索引块. # 不要将其设置大于你可用内存的30%, # 因为一部分内存同样被os用来缓冲行数据 # 甚至在你并不使用myisam 表的情况下, 你也需要仍旧设置起 8-64m 内存由于它同样会被内部临时磁盘表使用. key_buffer_size = 32m # myisam uses special tree-like cache to make bulk inserts (that is, # insert ... select, insert ... values (...), (...), ..., and load data # infile) faster. this variable limits the size of the cache tree in # bytes per thread. setting it to 0 will disable this optimisation. do # not set it larger than "key_buffer_size" for optimal performance. # this buffer is allocated when a bulk insert is detected. # myisam 使用特殊的类似树的cache来使得突发插入 # (这些插入是,insert … select, insert … values (…), (…), …, 以及 load data # infile) 更快. 此变量限制每个进程中缓冲树的字节数. # 设置为 0 会关闭此优化. # 为了最优化不要将此值设置大于 “key_buffer_size”. # 当突发插入被检测到时此缓冲将被分配. bulk_insert_buffer_size = 64m # this buffer is allocated when mysql needs to rebuild the index in # repair, optimize, alter table statements as well as in load data infile # into an empty table. it is allocated per thread so be careful with # large settings. # 此缓冲当mysql需要在 repair, optimize, alter 以及 load data infile 到一个空表中引起重建索引时被分配. # 这在每个线程中被分配.所以在设置大值时需要小心. myisam_sort_buffer_size = 128m # the maximum size of the temporary file mysql is allowed to use while # recreating the index (during repair, alter table or load data infile. # if the file-size would be bigger than this, the index will be created # through the key cache (which is slower). # mysql重建索引时所允许的最大临时文件的大小 (当 repair, alter table 或者 load data infile). # 如果文件大小比此值更大,索引会通过键值缓冲创建(更慢) myisam_max_sort_file_size = 10g # if a table has more than one index, myisam can use more than one # thread to repair them by sorting in parallel. this makes sense if you # have multiple cpus and plenty of memory. # 如果一个表拥有超过一个索引, myisam 可以通过并行排序使用超过一个线程去修复他们. # 这对于拥有多个cpu以及大量内存情况的用户,是一个很好的选择. myisam_repair_threads = 1 # automatically check and repair not properly closed myisam tables. # 自动检查和修复没有适当关闭的 myisam 表. myisam_recover # *** innodb specific options *** # *** innodb 相关选项 *** # use this option if you have a mysql server with innodb support enabled # but you do not plan to use it. this will save memory and disk space # and speed up some things. # 如果你的mysql服务包含innodb支持但是并不打算使用的话, # 使用此选项会节省内存以及磁盘空间,并且加速某些部分 #skip-innodb # additional memory pool that is used by innodb to store metadata # information. if innodb requires more memory for this purpose it will # start to allocate it from the os. as this is fast enough on most # recent operating systems, you normally do not need to change this # value. show innodb status will display the current amount used. # 附加的内存池被innodb用来保存 metadata 信息 # 如果innodb为此目的需要更多的内存,它会开始从os这里申请内存. # 由于这个操作在大多数现代操作系统上已经足够快, 你一般不需要修改此值. # show innodb status 命令会显示当先使用的数量. innodb_additional_mem_pool_size = 16m # innodb, unlike myisam, uses a buffer pool to cache both indexes and # row data. the bigger you set this the less disk i/o is needed to # access data in tables. on a dedicated database server you may set this # parameter up to 80% of the machine physical memory size. do not set it # too large, though, because competition of the physical memory may # cause paging in the operating system. note that on 32bit systems you # might be limited to 2-3.5g of user level memory per process, so do not # set it too high. # innodb使用一个缓冲池来保存索引和原始数据, 不像 myisam. # 这里你设置越大,你在存取表里面数据时所需要的磁盘i/o越少. # 在一个独立使用的数据库服务器上,你可以设置这个变量到服务器物理内存大小的80% # 不要设置过大,否则,由于物理内存的竞争可能导致操作系统的换页颠簸. # 注意在32位系统上你每个进程可能被限制在 2-3.5g 用户层面内存限制, # 所以不要设置的太高. innodb_buffer_pool_size = 2g # innodb stores data in one or more data files forming the tablespace. # if you have a single logical drive for your data, a single # autoextending file would be good enough. in other cases, a single file # per device is often a good choice. you can configure innodb to use raw # disk partitions as well - please refer to the manual for more info # about this. # innodb 将数据保存在一个或者多个数据文件中成为表空间. # 如果你只有单个逻辑驱动保存你的数据,一个单个的自增文件就足够好了. # 其他情况下.每个设备一个文件一般都是个好的选择. # 你也可以配置innodb来使用裸盘分区 – 请参考手册来获取更多相关内容 innodb_data_file_path = ibdata1:10m:autoextend # set this option if you would like the innodb tablespace files to be # stored in another location. by default this is the mysql datadir. # 设置此选项如果你希望innodb表空间文件被保存在其他分区. # 默认保存在mysql的datadir中. #innodb_data_home_dir = <directory> # number of io threads to use for async io operations. this value is # hardcoded to 8 on unix, but on windows disk i/o may benefit from a # larger number. # 用来同步io操作的io线程的数量. this value is # 此值在unix下被硬编码为8,但是在windows磁盘i/o可能在一个大数值下表现的更好. innodb_write_io_threads = 8 innodb_read_io_threads = 8 # if you run into innodb tablespace corruption, setting this to a nonzero # value will likely help you to dump your tables. start from value 1 and # increase it until you're able to dump the table successfully. # 如果你发现innodb表空间损坏, 设置此值为一个非零值可能帮助你导出你的表. # 从1开始并且增加此值知道你能够成功的导出表. #innodb_force_recovery=1 # number of threads allowed inside the innodb kernel. the optimal value # depends highly on the application, hardware as well as the os # scheduler properties. a too high value may lead to thread thrashing. # 在innodb核心内的允许线程数量. # 最优值依赖于应用程序,硬件以及操作系统的调度方式. # 过高的值可能导致线程的互斥颠簸. innodb_thread_concurrency = 16 # if set to 1, innodb will flush (fsync) the transaction logs to the # disk at each commit, which offers full acid behavior. if you are # willing to compromise this safety, and you are running small # transactions, you may set this to 0 or 2 to reduce disk i/o to the # logs. value 0 means that the log is only written to the log file and # the log file flushed to disk approximately once per second. value 2 # means the log is written to the log file at each commit, but the log # file is only flushed to disk approximately once per second. # 如果设置为1 ,innodb会在每次提交后刷新(fsync)事务日志到磁盘上, # 这提供了完整的acid行为. # 如果你愿意对事务安全折衷, 并且你正在运行一个小的食物, 你可以设置此值到0或者2来减少由事务日志引起的磁盘i/o # 0代表日志只大约每秒写入日志文件并且日志文件刷新到磁盘. # 2代表日志写入日志文件在每次提交后,但是日志文件只有大约每秒才会刷新到磁盘上. innodb_flush_log_at_trx_commit = 1 # speed up innodb shutdown. this will disable innodb to do a full purge # and insert buffer merge on shutdown. it may increase shutdown time a # lot, but innodb will have to do it on the next startup instead. # 加速innodb的关闭. 这会阻止innodb在关闭时做全清除以及插入缓冲合并. # 这可能极大增加关机时间, 但是取而代之的是innodb可能在下次启动时做这些操作. #innodb_fast_shutdown # the size of the buffer innodb uses for buffering log data. as soon as # it is full, innodb will have to flush it to disk. as it is flushed # once per second anyway, it does not make sense to have it very large # (even with long transactions). # 用来缓冲日志数据的缓冲区的大小. # 当此值快满时, innodb将必须刷新数据到磁盘上. # 由于基本上每秒都会刷新一次,所以没有必要将此值设置的太大(甚至对于长事务而言) innodb_log_buffer_size = 8m # size of each log file in a log group. you should set the combined size # of log files to about 25%-100% of your buffer pool size to avoid # unneeded buffer pool flush activity on log file overwrite. however, # note that a larger logfile size will increase the time needed for the # recovery process. # 在日志组中每个日志文件的大小. # 你应该设置日志文件总合大小到你缓冲池大小的25%~100% # 来避免在日志文件覆写上不必要的缓冲池刷新行为. # 不论如何, 请注意一个大的日志文件大小会增加恢复进程所需要的时间. innodb_log_file_size = 256m # total number of files in the log group. a value of 2-3 is usually good # enough. # 在日志组中的文件总数. # 通常来说2~3是比较好的. innodb_log_files_in_group = 3 # location of the innodb log files. default is the mysql datadir. you # may wish to point it to a dedicated hard drive or a raid1 volume for # improved performance # innodb的日志文件所在位置. 默认是mysql的datadir. # 你可以将其指定到一个独立的硬盘上或者一个raid1卷上来提高其性能 #innodb_log_group_home_dir # maximum allowed percentage of dirty pages in the innodb buffer pool. # if it is reached, innodb will start flushing them out agressively to # not run out of clean pages at all. this is a soft limit, not # guaranteed to be held. # 在innodb缓冲池中最大允许的脏页面的比例. # 如果达到限额, innodb会开始刷新他们防止他们妨碍到干净数据页面. # 这是一个软限制,不被保证绝对执行. innodb_max_dirty_pages_pct = 90 # the flush method innodb will use for log. the tablespace always uses # doublewrite flush logic. the default value is "fdatasync", another # option is "o_dsync". # innodb用来刷新日志的方法. # 表空间总是使用双重写入刷新方法 # 默认值是 “fdatasync”, 另一个是 “o_dsync”. #innodb_flush_method=o_dsync # how long an innodb transaction should wait for a lock to be granted # before being rolled back. innodb automatically detects transaction # deadlocks in its own lock table and rolls back the transaction. if you # use the lock tables command, or other transaction-safe storage engines # than innodb in the same transaction, then a deadlock may arise which # innodb cannot notice. in cases like this the timeout is useful to # resolve the situation. # 在被回滚前,一个innodb的事务应该等待一个锁被批准多久. # innodb在其拥有的锁表中自动检测事务死锁并且回滚事务. # 如果你使用 lock tables 指令, 或者在同样事务中使用除了innodb以外的其他事务安全的存储引擎 # 那么一个死锁可能发生而innodb无法注意到. # 这种情况下这个timeout值对于解决这种问题就非常有帮助. innodb_lock_wait_timeout = 120 [mysqldump] # do not buffer the whole result set in memory before writing it to # file. required for dumping very large tables # 不要在将内存中的整个结果写入磁盘之前缓存. 在导出非常巨大的表时需要此项 quick max_allowed_packet = 16m [mysql] no-auto-rehash # only allow updates and deletes that use keys. # 仅仅允许使用键值的 updates 和 deletes . #safe-updates [myisamchk] key_buffer_size = 512m sort_buffer_size = 512m read_buffer = 8m write_buffer = 8m [mysqlhotcopy] interactive-timeout [mysqld_safe] # increase the amount of open files allowed per process. warning: make # sure you have set the global system limit high enough! the high value # is required for a large number of opened tables # 增加每个进程的可打开文件数量. # 警告: 确认你已经将全系统限制设定的足够高! # 打开大量表需要将此值设大 open-files-limit = 8192
三、配置文件优化(根据实际情况优化)
说明,上文中我对my-innodb-heavy-4g.cnf中默认的所有选项进行了说明,下面我就根据我们公司的实际情况进行优化!
1.服务器的运行环境
硬件服务器:dell r710,双至强e5620 cpu、16g内存、6*500g硬盘
操作系统:centos5.5 x86_64 系统
mysql版本:mysql 5.5.32
适用于:日ip 100-200w ,日pv 200-500w 的站点
2.具体优化配置如下
[client] port = 3306 socket = /tmp/mysql.sock default-character-set = utf8 #设置客户端的字符编码 [mysqld] # generic configuration options port = 3306 socket = /tmp/mysql.sock #*** char set *** character-set-server = utf8 #设置服务器端的字符编码 #*** network *** back_log = 512 #skip-networking #默认没有开启 max_connections = 3000 max_connect_errors = 30 table_open_cache = 4096 #external-locking #默认没有开启 max_allowed_packet = 32m max_heap_table_size = 128m # *** global cache *** read_buffer_size = 8m read_rnd_buffer_size = 64m sort_buffer_size = 16m join_buffer_size = 16m # *** thread *** thread_cache_size = 16 thread_concurrency = 8 thread_stack = 512k # *** query cache *** query_cache_size = 128m query_cache_limit = 4m # *** index *** ft_min_word_len = 8 #memlock #默认没有开启 default-storage-engine = innodb transaction_isolation = repeatable-read # *** tmp table *** tmp_table_size = 64m # *** bin log *** log-bin=mysql-bin binlog_cache_size = 4m binlog_format=mixed #log_slave_updates #默认没有开启 #log #默认没有开启,此处是查询日志,开启会影响服务器性能 log_warnings #开启警告日志 # *** slow query log *** slow_query_log long_query_time = 10 # *** replication related settings server-id = 1 #server-id = 2 #master-host = <hostname> #master-user = <username> #master-password = <password> #master-port = <port> #read_only #*** myisam specific options key_buffer_size = 128m bulk_insert_buffer_size = 256m myisam_sort_buffer_size = 256m myisam_max_sort_file_size = 10g myisam_repair_threads = 1 myisam_recover # *** innodb specific options *** #skip-innodb #默认没有开启 innodb_additional_mem_pool_size = 64m innodb_buffer_pool_size = 6g #注意在32位系统上你每个进程可能被限制在 2-3.5g 用户层面内存限制, 所以不要设置的太高. innodb_data_file_path = ibdata1:10m:autoextend #innodb_data_home_dir = <directory> innodb_write_io_threads = 8 innodb_read_io_threads = 8 #innodb_force_recovery=1 innodb_thread_concurrency = 16 innodb_flush_log_at_trx_commit = 2 #说明:innodb_flush_log_at_trx_commit = 2 如果是游戏服务器,建议此值设置为2;如果是对数据安全要求极高的应用,建议设置为1;设置为0性能最高,但如果发生故障,数据可能会有丢失的危险!默认值1的意思是每一次事务提交或事务外的指令都需要把日志写入(flush)硬盘,这是很费时的。特别是使用电池供电缓存(battery backed up cache)时。设成2对于很多运用,特别是从myisam表转过来的是可以的,它的意思是不写入硬盘而是写入系统缓存。日志仍然会每秒flush到硬盘,所以你一般不会丢失超过1-2秒的更新。设成0会更快一点,但安全方面比较差,即使mysql挂了也可能会丢失事务的数据。而值2只会在整个操作系统挂了时才可能丢数据。 #innodb_fast_shutdown innodb_log_buffer_size = 16m innodb_log_file_size = 512m innodb_log_files_in_group = 3 #innodb_log_group_home_dir innodb_max_dirty_pages_pct = 90 #innodb_flush_method=o_dsync innodb_lock_wait_timeout = 120 [mysqldump] quick max_allowed_packet = 32m [mysql] no-auto-rehash [myisamchk] key_buffer_size = 2048m sort_buffer_size = 2048m read_buffer = 32m write_buffer = 32m [mysqlhotcopy] interactive-timeout [mysqld_safe] open-files-limit = 10240
3.总结
mysql 配置文件的优化是根据线上环境的实际需要进行优化,不能随便没有根据的进行优化,写这篇博文就是给博友们一些参考!
4.mysql状态查看的常用命令
mysql> show status; #显示状态信息 mysql> show variables; #显示系统变量 mysql> show engines; #查看所有引擎 mysql> show engine innodb status; #显示innodb存储引擎的状态
本文出自 “share your knowledge …” 博客
经过小编的测试,这样的效率很不错,直接拿来就可以使用。
下一篇: 防止mysql重复插入记录的方法
推荐阅读
-
MySQL 5.5.49 大内存优化配置文件优化详解
-
mysql服务性能优化—my.cnf_my.ini配置说明详解(16G内存)_MySQL
-
MySQL配置文件my.cnf中文详解附mysql性能优化方法分享
-
MySQL配置文件my.cnf中文详解附mysql性能优化方法分享
-
MySQL配置文件my.cnf参数优化详解
-
MySQL-5.5.32 配置文件优化详解
-
MySql优化之InnoDB,4GB内存,多查询的my.ini中文配置方案详解
-
MySQL配置文件my.cnf参数优化和中文详解_MySQL
-
mysql服务性能优化—my.cnf_my.ini配置说明详解(16G内存)_MySQL
-
MySQL中关于4G内存服务器配置如何优化的实例详解