golden gate 加initial load 在rac 上的配置

前言
goldengate 11g 在oracle 11g rac 上的配置 （源是rac+asm , 目标是单数据库实例）

源端：

1. 配置tnsnames

[oracle@rac1 admin]$ more tnsnames.ora
# tnsnames.ora network configuration file: /u01/app/oracle/product/11.2.0/db_1/network/admin/tnsnames.ora
# generated by oracle configuration tools.

sunrac =
(description =
(address = (protocol = tcp)(host = rac1)(port = 1522))
(connect_data =
(server = dedicated)
(service_name = sunrac)
)
)
asm =
(description =
(address = (protocol = tcp)(host = rac1)(port = 1522))
(connect_data =
(server = dedicated)
(service_name = +asm)
(sid_name = +asm1)
)
)

我只是测试，所以只在第一个节点上做

2. 数据库环境准备，添加最小附加日志

sql> alter database add supplemental log data;
database altered.
sql> alter system switch logfile;
system altered.
sql> select supplemental_log_data_min from v$database;
suppleme
--------
yes

创建测试表：
sql> conn test/test
connected.
sql> create table mxm (id int,name varchar2(80));
table created.
sql> begin
2 for i in 1 .. 1000000 loop
3 insert into mxm values (i,'mic');
4 end loop;
5 commit;
6 end;
7 /

pl/sql procedure successfully completed.

sql> select count(*) from mxm;

count(*)
----------
1000000
sql> select bytes/1024/1024 from user_segments where segment_name='mxm'; ---看一下数据量，最后好算算传输率

bytes/1024/1024
---------------
16

创建goldengate 用户并赋予dba 权限（避免权限的麻烦）
sql> create user ogg identified by ogg;
user created.
sql> grant dba to ogg;
grant succeeded.

3. 安装ogg
略

4. 配置ogg mgr

[oracle@rac1 goldengate]$ ./ggsci
ggsci (rac1) 1> create subdirs

配置mgr 端口：
ggsci (rac1) 1> edit param mgr
ggsci (rac1) 2> view param mgr
port 7809
ggsci (rac1) 3> start mgr
ggsci (rac1) 4> info all

5.配置抽取进程和传输进程

ggsci (rac1) 3> edit param exttest
ggsci (rac1) 4> view param exttest
extract exttest
userid ogg@sunrac,password ogg
tranlogoptions asmuser sys@asm,asmpassword beijing123 --登录asm的
exttrail ./dirdat/mm
table test.mxm;

ggsci (rac1) 6> edit param pumptest
ggsci (rac1) 7> view param pumptest
extract pumptest
rmthost 192.168.56.109,mgrport 7809,compress
rmttrail ./dirdat/mm
passthru
table test.mxm;

ggsci (rac1 as ogg@sunrac1) 10> add extract exttest,tranlog,begin now threads 2 --因为我的rac 是2个节点的，所以是threads 2
extract added.

ggsci (rac1 as ogg@sunrac1) 11> add exttrail ./dirdat/mm,extract exttest,megabytes 5
exttrail added.

ggsci (rac1 as ogg@sunrac1) 12> add extract pumptest,exttrailsource ./dirdat/mm --添加source dir
extract added.
ggsci (rac1 as ogg@sunrac1) 14> add rmttrail ./dirdat/mm,extract pumptest,megabytes 5 --添加remote dir
rmttrail added.

添加trandata

ggsci (rac1) 15> dblogin userid ogg@sunrac,password ogg
successfully logged into database.

ggsci (rac1 as ogg@sunrac1) 16> add trandata test.mxm

6. 配置init 进程

ggsci (rac1) 2> edit param inittest

ggsci (rac1) 4> view param inittest
extract inittest
userid ogg,password ogg
rmthost 192.168.56.109,mgrport 7809
rmttask replicat,group initrep --目标端init接收进程名
table test.mxm;

ggsci (rac1) 6> add extract inittest, sourceistable
extract added.

目标端

1. 创建相应的表

sql> create table mxm (id int,name varchar2(80));
table created.

2. 安装ogg
略

3. 配置mgr

ggsci (oracledg) 1> edit param mgr
ggsci (oracledg) 2> view param mgr
port 7809
accessrule, prog *, ipaddr 192.168.56.101, allow --没有这行，inittest 进程无法启动目标端的initrep进程

ggsci (oracledg) 4> start mgr

ggsci (oracledg) 5> edit params ./globals

ggsci (oracledg) 6> view params ./globals
ggschema ogg
checkpointtable ogg.checkpointtab

ggsci (oracledg) 8> dblogin userid ogg,password ogg
successfully logged into database.

ggsci (oracledg as ogg@mic) 9> add checkpointtable

4. 配置rep 进程

ggsci (oracledg as ogg@mic) 11> edit param reptest

ggsci (oracledg as ogg@mic) 12> view param reptest

replicat reptest
userid ogg,password ogg
handlecollisions
assumetargetdefs
discardfile ./dirrpt/reptest.dsc,append
map test.mxm, target test.mxm;

ggsci (oracledg as ogg@mic) 13> add replicat reptest,exttrail ./dirdat/mm
replicat added.

5.配置initrep 的进程

ggsci (oracledg as ogg@mic) 16> edit param initrep --名字必须和inittest进程中的配置一样

ggsci (oracledg as ogg@mic) 17> view param initrep
replicat initrep
userid ogg,password ogg
assumetargetdefs
discardfile ./dirrpt/initrep.dsc,append,megabytes 100
map test.mxm, target test.mxm;

开始同步和初始化

源端：

ggsci (rac1) 5> info all

program status group lag at chkpt time since chkpt

manager running
extract stopped exttest 00:00:00 02:46:12
extract stopped pumptest 00:00:00 02:43:19

这里看不到inittest 进程

启动抽取进程
ggsci (rac1) 6> start exttest

sending start request to manager ...
extract exttest starting

启动pump进程
ggsci (rac1) 8> start pumptest

sending start request to manager ...
extract pumptest starting

ggsci (rac1) 9> info all

program status group lag at chkpt time since chkpt

manager running
extract running exttest 00:00:00 00:00:11
extract running pumptest 00:00:00 00:00:02

启动inittest 进程
ggsci (rac1) 10> start inittest -- 这个进程可以直接连通目标端的initrep进程，所以目标端不用再启动initrep进程

sending start request to manager ...
extract inittest starting

模拟插入数据

sql> begin
2 for i in 1000000 .. 1000100 loop
3 insert into mxm values (i,'mic');
4 dbms_lock.sleep(10);
5 end loop;
6 commit;
7 end;
8 /

目标端

启动rep进程，
ggsci (oracledg as ogg@mic) 1> start reptest

sending start request to manager ...
replicat reptest starting

这里不需要启动initrep进程

源端

观察inittest进程情况

ggsci (rac1) 12> view report inittest
...
2019-02-26 14:48:31 warning ogg-06439 no unique key is defined for table mxm. all viable columns will be used to represent the key, but may not guarantee uniqueness. keycols
may be used to define the key.

2019-02-26 14:48:31 info ogg-06509 using the following key columns for source table test.mxm: id, name.

2019-02-26 14:48:37 info ogg-02911 processing table test.mxm.

***********************************************************************
* ** run time statistics ** *
***********************************************************************

report at 2019-02-26 14:52:39 (activity since 2019-02-26 14:48:31)

output to initrep:

from table test.mxm:
# inserts: 1000052
# updates: 0
# deletes: 0
# discards: 0

redo log statistics
bytes parsed 0
bytes output 76893373

可以看到初始或进程完成，用时大概4分钟多

停止insert sql,并查询总行数
sql> select count(*) from mxm;

count(*)
----------
1000121

目标端

sql> select count(*) from mxm;

count(*)
----------
1000121

至此，goldengate 同步initial load初始化配置完成 ， 但是用4分钟的时间传输了16m的数据，性能实在太差了。