欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页  >  数据库

postgreSQL pgfincore introduces

程序员文章站 2022-06-17 13:38:58
...

postgreSQL pgfincore introduces pgfincore 和shared buffer不同,是OS层面的缓存,可以把大对象缓存到OS的cache里,其实就是内存,所以机器的内存配置越大越好,至于oracle是缓存到buffer_pool_keep,可以手工刷出,不过这个是database的缓存,和pg的share

postgreSQL pgfincore introduces

pgfincore 和shared buffer不同,是OS层面的缓存,可以把大对象缓存到OS的cache里,其实就是内存,所以机器的内存配置越大越好,至于oracle是缓存到buffer_pool_keep,可以手工刷出,不过这个是database的缓存,和pg的shared buffer同理。这里就不再详细介绍。

1.下载wget http://pgfoundry.org/frs/download.php/3186/pgfincore-v1.1.1.tar.gz

2.解压下载的安装包tar -zxvf pgfincore-v1.1.1.tar.gz

3.复制解压后的目录到pg源代码目录/contrib

4.安装:

postgres用户:

make clean

make

su - root

source /home/postgres/.bash_profile

make install

根据READ.rst

For PostgreSQL >= 9.1, log in your database and::

mydb=# CREATE EXTENSION pgfincore;

For other release, create the functions from the sql script (it should be in

your contrib directory)::

psql mydb -f pgfincore.sql

postgres=# select version();

version

---------------------------------------------------

PostgreSQL 9.1.2 on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.1.2 20071124 (Red Hat 4.1.2-42), 64-bit

postgres=# CREATE EXTENSION pgfincore;

CREATE EXTENSION

postgres=# select * from pg_extension ;

extname | extowner | extnamespace | extrelocatable | extversion | extconfig | extcondition

----------------+----------+--------------+----------------+------------+-----------+--------------

plpgsql | 10 | 11 | f | 1.0 | |

pg_buffercache | 10 | 2200 | t | 1.0 | |

pgfincore | 10 | 2200 | t | 1.1.1 | |

pgfincore使用:

pgfincore 对象的cache情况

pgfadvise_willneed 将对象刷入cache

pgfadvise_dontneed 将对象刷出cache

pgfadvise_loader 直接和page cache交互,加载,卸载页面

pgsysconf 操作系统的cache情况

pgsysconf_pretty同上,只不过输更易懂,带上了单位。

postgres=# \d t

Table "public.t"

Column | Type | Modifiers

--------+---------+-----------------------------------------------

s | integer | not null default nextval('t_s_seq'::regclass)

i | integer |

postgres=# insert into t(i) values (generate_series(1,10000000));

INSERT 0 10000000

postgres=# select pg_size_pretty(pg_relation_size('t'));

pg_size_pretty

----------------

346 MB

当前文件系统的使用情况:pgsysconf(),pgsysconf_pretty()

postgres=# select * from pgsysconf();

os_page_size | os_pages_free | os_total_pages

--------------+---------------+----------------

4096 | 182787 | 2044328

postgres=# select * from pgsysconf_pretty();

os_page_size | os_pages_free | os_total_pages

--------------+---------------+----------------

4096 bytes | 721 MB | 7986 MB

(1 row)

表t的使用情况:pgfincore

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88496 | 1 | 181767 |

os_page_size:文件系统页大小

rel_os_pages:占用文件系统页数量

pages_mem:有多少文件系统页在系统cache

刷入cache:pgfadvise_willneed()

postgres=# select * from pgfadvise_willneed('t');

relpath | os_page_size | rel_os_pages | os_pages_free

------------------+--------------+--------------+---------------

base/12699/16441 | 4096 | 88496 | 186428

(1 row)

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88496 | 1 | 186397 |

(1 row)

刷出cache:

postgres=# select * from pgfadvise_dontneed('t');

relpath | os_page_size | rel_os_pages | os_pages_free

------------------+--------------+--------------+---------------

base/12699/16441 | 4096 | 88496 | 275021

(1 row)

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 0 | 0 | 275052 |

(1 row)

pgfadvise_loader:

postgres=# select * from pgfadvise_loader('t', 0, true, true, B'111000');

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186626 | 3 | 3

(1 row)

loading:

postgres=# select * from pgfadvise_loader('t', 0, true, false, B'111000');

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186460 | 3 | 0

(1 row)

unloading:

postgres=# select * from pgfadvise_loader('t', 0, false, true, B'111000');

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186557 | 0 | 3

(1 row)

pgfadvise_NORMAL

pgfadvise_SEQUENTIAL

pgfadvise_RANDOM

这几个可以指定当前内存的属性,正常,顺序,还是随机。

快照与恢复:

做快照:

create table pgfincore_snapshot as

select 't'::text as relname,*,now() as date_snapshot

from pgfincore('t',true);

应用快照:

select * from pgfadvise_loader('t', 0, true, true,

(select databit from pgfincore_snapshot

where relname='t' and segment = 0));

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186259 | 88490 | 6

(1 row)

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88490 | 2 | 186097 |

(1 row)

可以看到 88496 和88490,有几个页面是刷出cache,所以不相等

select * from pgfadvise_willneed('t');

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88496 | 1 | 186227 |

(1 row)

限制:

*PgFincore needs mincore() and POSIX_FADVISE.

*PgFincore has a limited mode when POSIX_FADVISE is not provided by the platform.

*PgFincore needs PostgreSQL >= 8.3