M102: MongoDB for DBAs chapter 6 Scalability

运行环境

操作系统：windows 10 家庭中文版
Mongodb ：Mongodb 3.4

Mongodb安装路径：E:>MongoDB\Server\3.4\bin\
Mongodb存储路径：E:>MongoDB\data

课后习题

5.1题目

Download Handouts:

week6__hw6.1_m102_52b491d5e2d4237593ca1d3a.js

For this week’s homework we will start with a standalone MongoDB database, turn it into a sharded cluster with two shards, and shard one of the collections. We will create a “dev” environment on our local box: no replica sets, and only one config server. In production you would almost always use three config servers and replica sets as part of a sharded cluster. In the final of the course we’ll set up a larger cluster with replica sets and three config servers.

Download the handout.

Start an initially empty mongod database instance.

Connect to it with the shell and week6.js loaded:

mongo --shell localhost/week6 week6.js

Run homework.init(). It will take some time to run as it inserts quite a few documents. When it is done run

db.trades.stats()

to check the status of the collection.

At this point we have a single mongod and would like to transform it into a sharded cluster with one shard. (We’ll use this node’s existing week6.trades data in the cluster.)

Stop the mongod process. Now, restart the mongod process adding the option –shardsvr. If you started mongod with a –dbpath option, specify that as well.

mongod --shardsvr ...

Note that with –shardsvr specified the default port for mongod becomes 27018.

Start a mongo config server:

mongod --configsvr ...

Note: configuration server setup has changed. If you are using MongoDB 3.4 you must set up your configuration servers with CSRS. An example setup is as follows:

mongod --configsvr --replSet csReplSet ...
mongod --configsvr --replSet csReplSet ...
mongod --configsvr --replSet csReplSet ...

mongo --port 27019

config = { _id: "csReplSet", members:[
         { _id : 0, host : "localhost:27019" },
         { _id : 1, host : "localhost:27020" },
         { _id : 2, host : "localhost:27021" }]};
rs.initiate(config)

(Note with –configsvr specified the default port for listening becomes 27019 and the default data directory /data/configdb. Wherever your data directory is, it is suggested that you verify that the directory is empty before you begin.)

Start a mongos:

mongos --configdb csReplSet/<your_host_name>:27019

Connect to mongos with the shell:

mongo --shell localhost/week6 week6.js

Add the first shard (“your_host_name:27018”).

Verify that the week6.trades data is visible via mongos. Note at this point the week6 database isn’t “sharding enabled” but its data is still visible via mongos:

db.trades.find().pretty()
db.trades.count()
db.trades.stats()

Run homework.a() and enter the result below. This method will simply verify that this simple cluster is up and running and return a result key.

解答

1000001

6.2题目

Now enable sharding for the week6 database. (See sh.help() for details.)

Then shard the trades collection on the compound shard key ticker plus time. Note to shard a collection, you must have an index on the shard key, so you will need to create the index first:

db.trades.createIndex( { ticker : 1, time : 1 } )
// can now shard the trades collection on the shard key  { ticker:1, time:1 }

After sharding the collection, look at the chunks which exist:

use config
db.chunks.find()
// or:
db.chunks.find({}, {min:1,max:1,shard:1,_id:0,ns:1})

Run homework.b() to verify the above and enter the return value below.

Enter answer here:

解答

3

6.3题目

Let’s now add a new shard. Run another mongod as the new shard on a new port number. Use –shardsvr.

Then add the shard to the cluster (see sh.help()).

You can confirm the above worked by running:

homework.check1()

Now wait for the balancer to move data among the two shards more evenly. Periodically run:

use config
db.chunks.find( { ns:"week6.trades" }, {min:1,max:1,shard:1,_id:0} ).sort({min:1})

and/or:

db.chunks.aggregate( [
 { $match : { ns : "week6.trades" } } ,
 { $group : { _id : "$shard", n : { $sum : 1 } } }
] )

When done, run homework.c() and enter the result value.

That completes this week’s homework. However if you want to explore more, something to try would be to try some queries and/or write operations with a single process down to see how the system behaves in such a situation.

解答

2