I want to use cosine similarity to identify the intent and pass it to RASA Core





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}







0















I want to use cosine similarity to identify the intent and pass it to RASA Core. In other words, I want to replace the NLU part with some other similarity calculation method.
How to do it?










share|improve this question































    0















    I want to use cosine similarity to identify the intent and pass it to RASA Core. In other words, I want to replace the NLU part with some other similarity calculation method.
    How to do it?










    share|improve this question



























      0












      0








      0








      I want to use cosine similarity to identify the intent and pass it to RASA Core. In other words, I want to replace the NLU part with some other similarity calculation method.
      How to do it?










      share|improve this question
















      I want to use cosine similarity to identify the intent and pass it to RASA Core. In other words, I want to replace the NLU part with some other similarity calculation method.
      How to do it?







      rasa-nlu rasa-core






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Jan 3 at 10:27









      Amir

      8,09774277




      8,09774277










      asked Jan 3 at 9:34









      SUBHOJEETSUBHOJEET

      394




      394
























          1 Answer
          1






          active

          oldest

          votes


















          1














          Currently, there is four classifiers implemented in Rasa-NLU:




          • sklearn_intent_classifier

          • mitie_intent_classifier

          • keyword_intent_classifier

          • embedding_intent_classifier


          If you use embedding_intent_classifier.py by default it is used cosine similarity:



          "similarity_type": 'cosine',  # string 'cosine' or 'inner'


          How to customize your pipeline?



          language: "en"

          pipeline:
          - name: "tokenizer_whitespace"
          - name: "ner_crf"
          - name: "ner_synonyms"
          - name: "intent_featurizer_count_vectors"
          - name: "intent_classifier_tensorflow_embedding"


          See here for more details.



          How to define my own Components?



          Inherit from parent object Component and implement your own. If you need to define tfidf and cosine read here, and then compare your code with here.



          from rasa_nlu.components import Component

          class MyComponent(Component):
          def __init__(self, component_config=None):
          pass

          def train(self, training_data, cfg, **kwargs):
          pass

          def process(self, message, **kwargs):
          pass

          def persist(self, model_dir):
          pass

          @classmethod
          def load(cls, model_dir=None, model_metadata=None, cached_component=None,
          **kwargs):


          Also do not forget to add it into pipeline:



          pipeline:
          - name: "MyComponent"





          share|improve this answer


























          • I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

            – SUBHOJEET
            Jan 4 at 4:11












          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54019553%2fi-want-to-use-cosine-similarity-to-identify-the-intent-and-pass-it-to-rasa-core%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          1














          Currently, there is four classifiers implemented in Rasa-NLU:




          • sklearn_intent_classifier

          • mitie_intent_classifier

          • keyword_intent_classifier

          • embedding_intent_classifier


          If you use embedding_intent_classifier.py by default it is used cosine similarity:



          "similarity_type": 'cosine',  # string 'cosine' or 'inner'


          How to customize your pipeline?



          language: "en"

          pipeline:
          - name: "tokenizer_whitespace"
          - name: "ner_crf"
          - name: "ner_synonyms"
          - name: "intent_featurizer_count_vectors"
          - name: "intent_classifier_tensorflow_embedding"


          See here for more details.



          How to define my own Components?



          Inherit from parent object Component and implement your own. If you need to define tfidf and cosine read here, and then compare your code with here.



          from rasa_nlu.components import Component

          class MyComponent(Component):
          def __init__(self, component_config=None):
          pass

          def train(self, training_data, cfg, **kwargs):
          pass

          def process(self, message, **kwargs):
          pass

          def persist(self, model_dir):
          pass

          @classmethod
          def load(cls, model_dir=None, model_metadata=None, cached_component=None,
          **kwargs):


          Also do not forget to add it into pipeline:



          pipeline:
          - name: "MyComponent"





          share|improve this answer


























          • I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

            – SUBHOJEET
            Jan 4 at 4:11
















          1














          Currently, there is four classifiers implemented in Rasa-NLU:




          • sklearn_intent_classifier

          • mitie_intent_classifier

          • keyword_intent_classifier

          • embedding_intent_classifier


          If you use embedding_intent_classifier.py by default it is used cosine similarity:



          "similarity_type": 'cosine',  # string 'cosine' or 'inner'


          How to customize your pipeline?



          language: "en"

          pipeline:
          - name: "tokenizer_whitespace"
          - name: "ner_crf"
          - name: "ner_synonyms"
          - name: "intent_featurizer_count_vectors"
          - name: "intent_classifier_tensorflow_embedding"


          See here for more details.



          How to define my own Components?



          Inherit from parent object Component and implement your own. If you need to define tfidf and cosine read here, and then compare your code with here.



          from rasa_nlu.components import Component

          class MyComponent(Component):
          def __init__(self, component_config=None):
          pass

          def train(self, training_data, cfg, **kwargs):
          pass

          def process(self, message, **kwargs):
          pass

          def persist(self, model_dir):
          pass

          @classmethod
          def load(cls, model_dir=None, model_metadata=None, cached_component=None,
          **kwargs):


          Also do not forget to add it into pipeline:



          pipeline:
          - name: "MyComponent"





          share|improve this answer


























          • I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

            – SUBHOJEET
            Jan 4 at 4:11














          1












          1








          1







          Currently, there is four classifiers implemented in Rasa-NLU:




          • sklearn_intent_classifier

          • mitie_intent_classifier

          • keyword_intent_classifier

          • embedding_intent_classifier


          If you use embedding_intent_classifier.py by default it is used cosine similarity:



          "similarity_type": 'cosine',  # string 'cosine' or 'inner'


          How to customize your pipeline?



          language: "en"

          pipeline:
          - name: "tokenizer_whitespace"
          - name: "ner_crf"
          - name: "ner_synonyms"
          - name: "intent_featurizer_count_vectors"
          - name: "intent_classifier_tensorflow_embedding"


          See here for more details.



          How to define my own Components?



          Inherit from parent object Component and implement your own. If you need to define tfidf and cosine read here, and then compare your code with here.



          from rasa_nlu.components import Component

          class MyComponent(Component):
          def __init__(self, component_config=None):
          pass

          def train(self, training_data, cfg, **kwargs):
          pass

          def process(self, message, **kwargs):
          pass

          def persist(self, model_dir):
          pass

          @classmethod
          def load(cls, model_dir=None, model_metadata=None, cached_component=None,
          **kwargs):


          Also do not forget to add it into pipeline:



          pipeline:
          - name: "MyComponent"





          share|improve this answer















          Currently, there is four classifiers implemented in Rasa-NLU:




          • sklearn_intent_classifier

          • mitie_intent_classifier

          • keyword_intent_classifier

          • embedding_intent_classifier


          If you use embedding_intent_classifier.py by default it is used cosine similarity:



          "similarity_type": 'cosine',  # string 'cosine' or 'inner'


          How to customize your pipeline?



          language: "en"

          pipeline:
          - name: "tokenizer_whitespace"
          - name: "ner_crf"
          - name: "ner_synonyms"
          - name: "intent_featurizer_count_vectors"
          - name: "intent_classifier_tensorflow_embedding"


          See here for more details.



          How to define my own Components?



          Inherit from parent object Component and implement your own. If you need to define tfidf and cosine read here, and then compare your code with here.



          from rasa_nlu.components import Component

          class MyComponent(Component):
          def __init__(self, component_config=None):
          pass

          def train(self, training_data, cfg, **kwargs):
          pass

          def process(self, message, **kwargs):
          pass

          def persist(self, model_dir):
          pass

          @classmethod
          def load(cls, model_dir=None, model_metadata=None, cached_component=None,
          **kwargs):


          Also do not forget to add it into pipeline:



          pipeline:
          - name: "MyComponent"






          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited Jan 4 at 5:59

























          answered Jan 3 at 10:40









          AmirAmir

          8,09774277




          8,09774277













          • I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

            – SUBHOJEET
            Jan 4 at 4:11



















          • I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

            – SUBHOJEET
            Jan 4 at 4:11

















          I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

          – SUBHOJEET
          Jan 4 at 4:11





          I want to use tf-idf vectorizer and then cosine similarity to find the best match. How to do it.

          – SUBHOJEET
          Jan 4 at 4:11




















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54019553%2fi-want-to-use-cosine-similarity-to-identify-the-intent-and-pass-it-to-rasa-core%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          MongoDB - Not Authorized To Execute Command

          How to fix TextFormField cause rebuild widget in Flutter

          in spring boot 2.1 many test slices are not allowed anymore due to multiple @BootstrapWith