mgnlq_parser1

mgnlq_parser1

Parse sentences into actions or queries

Parser for queries List all CAT CAT where CAT FACT = XX in DOM

npm i

gulp

String to Mongo Query conversion

• Entity
• Parsing
• AST 2 Mongo Query

recognition for mongo nlq

entity recognition based on word categorization

the word categorization contains a bitmap filter to retain only sencences which are homogeneous in one domain

entity recognition based on word categorization

Words are categorized according to an index (see mgnlq-model)

into

• "Facts",
• "Categories",
• "Domain",
• "Operators",
• "Fillers",
• "Any" (generic verbatim strings)

The word categorization contains a bitmap filter to retain only sencences which are homogeneous in one domain.

The word index is built by mgnlq_model

usage:

  var erbase = require('mgnlq_parser1');
  var words = {}; // a cache!
  var res = Erbase.processString('orbit of the earth', theModel.rules, words);

Adding an operator

• Add to operators.json including synonyms
• Add non-synonyms to mgnlq_model ifmatch.ts
• Add tests to erbase.nunit.js (testOperators)
• Add to tokens.json, run gulp makeToken
• Add to ast.ts ASTNodeType, astNodeTypes and
• Add tests to sentenceparser.nunit.js
• Add queryies to sentences_ast_mongoq.json
• Add Mongo AST to Query Processing to

scratch

Filtering elements in an array

https://stackoverflow.com/questions/3985214/retrieve-only-the-queried-element-in-an-object-array-in-mongodb-collection

db.test.aggregate([ // Get just the docs that contain a shapes element where color is 'red' {$match: {'shapes.color': 'red'}}, {$project: { shapes: {$filter: { input: '$shapes', as: 'shape', cond: {$eq: ['$$shape.color', 'red']} }}, _id: 0 }} ])

db.coll.aggregate( [ { "$match": { "_id": "123456" } }, { "$project": { "detailLine": { "$map": { "input": "$detailLine", "as": "dline", "in": { "amount": "$$dline.value.detailLineCharges.allowedAmount.amount", "reasonCode": "$$dline.value.detailLineCharges.allowedAmount.reasonCode" } } } }} ] )

environment

the default model name is "testmodel"

environment ABOT_MONGODB controls the used model, e.g. ABOT_MONGODB=testdb2

record

set MONGO_RECORD_REPLAY=

history

• 0.0.3 showURI, auxiliary categories
• 0.0.4 change in output format
• 0.0.5 add mass tests, upgrade gulp etc.

Test data

the tests run against recorded data in E:\projects\nodejs\botbuilder\mgnlq_testmodel_replay\mgrecrep\data\807d3ce983c2f3....

This data can be recorded by setting

SET MGNLQ_MODEL_NO_FILECACHE=1 SET MGNLQ_TESTMODEL_REPLAY=OFF | RECORD | REPLAY (default)

Todo

 more than N CAT    (List all Application Components with more than 3 Fiori Apps)

 real or
 associativity, parentheis

 and  CATA FACT_A or CATB FACTB =>   (( CAT_A )

 CAT_A FACT_A OR FACT_A   AND  XX   =     ( CAT_A FACT_A or CAT_A FACT_B )

 (FACT_A OR FACT_B ) OR  X    AND

 FA AND FB OR FC AND FE  =>    FA AND ( FB OR FC) AND FA