From 0bfbe0520a2f26d466ea105265e69e5afc1e8578 Mon Sep 17 00:00:00 2001 From: tactonbishop Date: Tue, 30 Aug 2022 14:00:04 +0100 Subject: [PATCH] Last Sync: 2022-08-30 14:00:04 --- .../Adding_documents_to_a_collection.md | 47 ++++++ .../Create_collections_and_documents.md | 144 ------------------ .../MongoDB/Creating_a_schema_and_model.md | 70 +++++++++ .../MongoDB/Validating_Mongoose_schemas.md | 53 +++++++ .../REST_APIs/05__Integrating_the_database.md | 18 +++ 5 files changed, 188 insertions(+), 144 deletions(-) create mode 100644 Databases/MongoDB/Adding_documents_to_a_collection.md delete mode 100644 Databases/MongoDB/Create_collections_and_documents.md create mode 100644 Databases/MongoDB/Creating_a_schema_and_model.md create mode 100644 Databases/MongoDB/Validating_Mongoose_schemas.md diff --git a/Databases/MongoDB/Adding_documents_to_a_collection.md b/Databases/MongoDB/Adding_documents_to_a_collection.md new file mode 100644 index 0000000..dd2e5a1 --- /dev/null +++ b/Databases/MongoDB/Adding_documents_to_a_collection.md @@ -0,0 +1,47 @@ +--- +categories: + - Databases +tags: [mongo_db, node_js, mongoose] +--- + +# Adding documents to a collection + +We have our database (`playground`) and collection (`courses`) established. We now need to add documents to our collection. We will do this via a function since this will be an asynchronous process: + +```js +const pythonCourse = new Course({ + name: "Python Course", + author: "Terry Ogleton", + tags: ["python", "backend"], + isPublished: true, +}); + +async function addCourseDocToDb(courseDocument) { + try { + const result = await courseDocument.save(); + console.log(result); + } catch (err) { + console.error(err.message); + } +} + +addCourseDocToDb(nodeCourse); +``` + +When we run this, we call the `save` method on the Mongoose schema. We will then have the Mongo document outputted to the console: + +``` +{ + name: 'Python Course', + author: 'Terry Ogleton', + tags: [ 'python' ], + isPublished: true, + _id: new ObjectId("62f4ac989d2fec2f01596b9b"), + date: 2022-08-11T07:15:36.978Z, + __v: 0 +} +``` + +This will also be reflected in Compass: + +![](/img/mongo-doc-added.png) diff --git a/Databases/MongoDB/Create_collections_and_documents.md b/Databases/MongoDB/Create_collections_and_documents.md deleted file mode 100644 index af12967..0000000 --- a/Databases/MongoDB/Create_collections_and_documents.md +++ /dev/null @@ -1,144 +0,0 @@ ---- -categories: - - Databases -tags: [mongo_db, node_js, mongoose] ---- - -# Create collections and documents with Mongoose - -## Collections and documents - -In order start adding collections and documents to our database, we use Mongoose's schema structure. This is specific to Mongoose and is not a structure that is a part of Mongo in general. - -We use a schema to define the shape of documents in a MongoDB collection. To do this we instantiate an instance of the Mongoose `Schema` class and set our properties: - -### Creating a schema - -```js -const courseSchema = new mongoose.Schema({ - name: {type: String, required: true, minlength: 5, maxlength: 255}, - author: String, - tags: [String], - data: {type: Date, default: Date.now}, // if unspecified, entry will default to current date - isPublished: Boolean, -}); -``` - -> This is similar to declaring a type or interface in TypeScript - -// TODO: Add printout of what the rejection will look like in the console. - -#### Available data types - -The following data types are available: - -- `String` -- `Number` -- `Boolean` -- `Array` -- `Date` -- `Buffer` -- `ObjectID` (for UUIDs) - -### Validating a schema - -Note that we set our validation criteria as the second property for each schema value. If it does not obtain, an exception will be thrown when we attempt to modify the database. This will most likely take the form of a Promise rejection. - -Note that this validation only occurs at the level of Mongoose. There is no mechanism for running the validation within the database itself. This is one of the ways that Mongo differs from an SQL database where you would be able to set the property of `required` for a cell in the table. If we didn't set any validation via Mongoose, Mongo would accept whatever we sent to it. - -What is the relationship between this Mongoose validation and the [Joi](/Programming_Languages/NodeJS/REST_APIs/Validation.md) validation that we use when validating API requests in Node/Express? They complement each other. We use Joi to validate the client request to the API. If this is valid, the process would then move onto the next stage which would be transforming the data from a REST request to a database request implemented through Mongoose, where a second layer of validation would appy. We would also have validation on the client-side. - -#### Validator functions - -Instead of simply applying a built-in validator like `required`, we can instead pass a function that validates agains the validation status of another property in the schema. For instance: make the `price` property required only if the entry has `true` for `isPublished`: - -```js -const courseSchema = new mongoose.Schema({ - ... - isPublished: Boolean, - price: { - type: Number, - required: function() {return this.isPublished} - } -}); -``` - -#### Enum validators - -An enum validator enables us to ensure that whatever value is passed when instantiating a document that is of a given schema type, it must be one of a finite set of values: - -```js -const anotherSchema = new mongoose.Schema({ - sex: { - type: String, - enum: ['male', 'female'], - }, -}); -``` - -### Models - -Once we have established our schema we can then create a **model** of it. A model is basically a class representation of the interface we define in the schema: - -```js -const Course = mongoose.model('Course', courseSchema); -``` - -With this in place, we can then create instances of the model. This stands in relation to the model as an object does to a class: - -```js -const course = new Course({ - name: 'Node.js Course', - author: 'Ozzy Osbourne', - tags: ['node', 'backend'], - isPublished: true, -}); -``` - -![](/img/mongoose-hierarchy.svg) - -Having created a database, connected to it with Mongoose, and created a model we will see our collection reflected in Compass: - -![](img/../../../img/mongo-collection.png) - -### Adding a document - -We have our database (`playground`) and collection (`courses`) established. We now need to add documents to our collection. We will move our previous code into a function since this will be an asynchronous process: - -```js -const pythonCourse = new Course({ - name: 'Python Course', - author: 'Terry Ogleton', - tags: ['python', 'backend'], - isPublished: true, -}); - -async function addCourseDocToDb(courseDocument) { - try { - const result = await courseDocument.save(); - console.log(result); - } catch (err) { - console.error(err.message); - } -} - -addCourseDocToDb(nodeCourse); -``` - -When we run this, we call the `save` method on the Mongoose schema. We will then have the Mongo document outputted to the console: - -``` -{ - name: 'Python Course', - author: 'Terry Ogleton', - tags: [ 'python' ], - isPublished: true, - _id: new ObjectId("62f4ac989d2fec2f01596b9b"), - date: 2022-08-11T07:15:36.978Z, - __v: 0 -} -``` - -This will also be reflected in Compass: - -![](/img/mongo-doc-added.png) diff --git a/Databases/MongoDB/Creating_a_schema_and_model.md b/Databases/MongoDB/Creating_a_schema_and_model.md new file mode 100644 index 0000000..2e63d6d --- /dev/null +++ b/Databases/MongoDB/Creating_a_schema_and_model.md @@ -0,0 +1,70 @@ +--- +categories: + - Databases +tags: [mongo_db, node_js, mongoose] +--- + +# Creating a schema and model + +## Schema + +In order start adding [collections and documents](/Databases/MongoDB/Introduction.md) to our database, we use Mongoose's **schema** structure. (This is specific to Mongoose and is not a structure that is a part of Mongo in general.) + +We use a schema to define the shape of documents in a MongoDB collection. To do this we instantiate an instance of the Mongoose `Schema` class and set our properties: + +### Creating a schema + +```js +const courseSchema = new mongoose.Schema({ + name: { type: String, required: true, minlength: 5, maxlength: 255 }, + author: String, + tags: [String], + data: { type: Date, default: Date.now }, // if unspecified, entry will default to current date + isPublished: Boolean, +}); +``` + +> This is similar to declaring a type or interface in TypeScript + +// TODO: Add printout of what the rejection will look like in the console. + +#### Available data types + +The following data types are available: + +- `String` +- `Number` +- `Boolean` +- `Array` +- `Date` +- `Buffer` +- `ObjectID` (for UUIDs) + +> Note that we set our validation criteria as the second property for each schema value. There is more info info on validation in a [separate entry](/Databases/MongoDB/Validating_Mongoose_schemas.md); + +## Models + +Once we have established our schema we can then create a **model** of it. A model is basically a class representation of the interface we define in the schema: + +```js +const Course = mongoose.model("Course", courseSchema); +``` + +Now we can start adding specific courses as documents to our collection. We do this by referring to the model, i.e. + +```js +const course = new Course({ + name: "Node.js Course", + author: "Ozzy Osbourne", + tags: ["node", "backend"], + isPublished: true, +}); +``` + +![](/img/mongoose-hierarchy.svg) + +## Outcome + +Having created a database, connected to it with Mongoose, and created a model we will see our collection reflected in Compass: + +![](img/../../../img/mongo-collection.png) diff --git a/Databases/MongoDB/Validating_Mongoose_schemas.md b/Databases/MongoDB/Validating_Mongoose_schemas.md new file mode 100644 index 0000000..2eef459 --- /dev/null +++ b/Databases/MongoDB/Validating_Mongoose_schemas.md @@ -0,0 +1,53 @@ +--- +categories: + - Databases +tags: [mongo_db, node_js, mongoose] +--- + +# Validating Mongoose schemas + +Let's say we have the following schema: + +```js +const courseSchema = new mongoose.Schema({ + name: { type: String, required: true, minlength: 5, maxlength: 255 }, + author: String, + tags: [String], + data: { type: Date, default: Date.now }, // if unspecified, entry will default to current date + isPublished: Boolean, +}); +``` + +We set our validation criteria as the second property for each schema value. If it does not obtain, an exception will be thrown when we attempt to modify the database. This will most likely take the form of a Promise rejection. + +Note that this validation only occurs at the level of Mongoose. There is no mechanism for running the validation within the database itself. This is one of the ways that Mongo differs from an SQL database where you would be able to set the property of `required` for a cell in the table. If we didn't set any validation via Mongoose, Mongo would accept whatever we sent to it. + +What is the relationship between this Mongoose validation and the [Joi](/Programming_Languages/NodeJS/REST_APIs/Validation.md) validation that we use when validating API requests in Node/Express? They complement each other. We use Joi to validate the client request to the API. If this is valid, the process would then move onto the next stage which would be transforming the data from a REST request to a database request implemented through Mongoose, where a second layer of validation would appy. We would also have validation on the client-side. + +## Validator functions + +Instead of simply applying a built-in validator like `required`, we can instead pass a function that validates agains the validation status of another property in the schema. For instance: make the `price` property required only if the entry has `true` for `isPublished`: + +```js +const courseSchema = new mongoose.Schema({ + ... + isPublished: Boolean, + price: { + type: Number, + required: function() {return this.isPublished} + } +}); +``` + +## Enum validators + +An enum validator enables us to ensure that whatever value is passed when instantiating a document that is of a given schema type, it must be one of a finite set of values: + +```js +const anotherSchema = new mongoose.Schema({ + sex: { + type: String, + enum: ["male", "female"], + }, +}); +``` diff --git a/Programming_Languages/NodeJS/REST_APIs/05__Integrating_the_database.md b/Programming_Languages/NodeJS/REST_APIs/05__Integrating_the_database.md index 4e3edf5..f3febac 100644 --- a/Programming_Languages/NodeJS/REST_APIs/05__Integrating_the_database.md +++ b/Programming_Languages/NodeJS/REST_APIs/05__Integrating_the_database.md @@ -76,3 +76,21 @@ const courseSchema = new mongoose.Schema({ + const Course = new mongoose.model('Course', courseSchema); ``` + +With this established we can remove our local array as we are ready to start getting our data from the database: + +```diff +const Course = new mongoose.model('Course', courseSchema); + +- const courses = [ +- { +- id: 1, +- name: "First course", +- }, +- ... +-]; +``` + +## Rewriting the REST handlers + +Now we need to rewrite our RESTful request handlers so that the data is sourced from and added to the database. We will mainly be using the Mongo syntax defined at [Querying a collection](/Databases/MongoDB/Querying_a_collection.md) and [Adding documents to a collection](/Databases/MongoDB/Adding_documents_to_a_collection.md).