<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Sentence Transformers on Subculture Science Research Group&#39;s Blog</title>
    <link>https://www.subcul-science.com/en/tags/sentence-transformers/</link>
    <description>Recent content in Sentence Transformers on Subculture Science Research Group&#39;s Blog</description>
    <generator>Hugo</generator>
    <language>en-US</language>
    <lastBuildDate>Wed, 17 Feb 2021 10:32:03 +0900</lastBuildDate>
    <atom:link href="https://www.subcul-science.com/en/tags/sentence-transformers/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Creating data in Natural Language Inference (NLI) format for Sentence transformer</title>
      <link>https://www.subcul-science.com/en/post/20210217nlibert/</link>
      <pubDate>Wed, 17 Feb 2021 10:32:03 +0900</pubDate>
      <guid>https://www.subcul-science.com/en/post/20210217nlibert/</guid>
      <description>&lt;p&gt;Using the Sentence Transformer to&#xA;I&amp;rsquo;m trying to use Sentence Transformer to infer causal relationships between documents.&lt;/p&gt;&#xA;&lt;p&gt;If we can do this, we can extract the cause and symptoms of the incident from the report.&lt;/p&gt;&#xA;&lt;p&gt;So, I wondered if NLI could be used for feature learning to extract causal information. I thought.&lt;/p&gt;&#xA;&lt;h2 id=&#34;what-is-nli&#34;&gt;What is NLI?&lt;/h2&gt;&#xA;&lt;p&gt;Inference of the relationship between two sentences&lt;/p&gt;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Forward&lt;/li&gt;&#xA;&lt;li&gt;Inverse&lt;/li&gt;&#xA;&lt;li&gt;Unrelated&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;p&gt;The three relations are.&lt;/p&gt;&#xA;&lt;h2 id=&#34;apply-to-causal-relationships&#34;&gt;Apply to causal relationships&lt;/h2&gt;&#xA;&lt;p&gt;If we apply the three relationships of NLI to causality, the following patterns are possible.&lt;/p&gt;</description>
    </item>
    <item>
      <title>How to train a Japanese model with Sentence transformer to get a distributed representation of a sentence</title>
      <link>https://www.subcul-science.com/en/post/20210203sbert/</link>
      <pubDate>Wed, 03 Feb 2021 15:58:41 +0900</pubDate>
      <guid>https://www.subcul-science.com/en/post/20210203sbert/</guid>
      <description>&lt;p&gt;.&#xA;BERT is a model that can be powerfully applied to natural language processing tasks.&lt;/p&gt;&#xA;&lt;p&gt;However, it does not do a good job of capturing sentence-wise features.&lt;/p&gt;&#xA;&lt;p&gt;Some claim that sentence features appear in [ CLS\ ], but&#xA;This paper](&lt;a href=&#34;https://arxiv.org/abs/1908.10084&#34;&gt;https://arxiv.org/abs/1908.10084&lt;/a&gt;) claims that it does not contain that much useful information for the task.&lt;/p&gt;&#xA;&lt;p&gt;Sentence BERT is a model that extends BERT to be able to obtain features per sentence.&lt;/p&gt;&#xA;&lt;p&gt;The following are the steps to create Sentence BERT in Japanese.&lt;/p&gt;</description>
    </item>
  </channel>
</rss>
